Software – Milan's blog

How to account for traffic in GCP

The following may be used as a custom metric to weight scale decisions.

SELECT TIMESTAMP_TRUNC(TIMESTAMP, MINUTE) AS ts,
sum(CAST (jsonPayload.bytes_sent AS INT64)) AS sent, jsonPayload.dest_instance.zone AS dst_zone, jsonPayload.dest_instance.vm_name
FROM delasport-prod.NetFlow.compute_googleapis_com_vpc_flows_*
WHERE _TABLE_SUFFIX IN (
FORMAT_DATE("%Y%m%d",CURRENT_DATE),
FORMAT_DATE("%Y%m%d", DATE_SUB(CURRENT_DATE, INTERVAL 1 DAY)))
AND TIMESTAMP_DIFF(TIMESTAMP_SUB(CURRENT_TIMESTAMP, INTERVAL 60 MINUTE),TIMESTAMP,MINUTE) < 60
AND jsonPayload.src_instance.zone IS NOT NULL
AND jsonPayload.dest_instance.zone IS NOT NULL
AND jsonPayload.src_instance.zone != jsonPayload.dest_instance.zone
AND jsonPayload.bytes_sent != "0" group by ts,jsonPayload.dest_instance.zone, jsonPayload.dest_instance.vm_name

SELECT
count(*) as cnt, _TABLE_SUFFIX as table_name
FROM
[$Project].[$dataset].*
Where _TABLE_SUFFIX like '%20201116%'
Group by table_name
Order by cnt DESC

GiGl first alpha version available

GiGl (Glycemic index/Glycemic load) is an app that I developed for personal usage. It is a fast way to check the expected response of your body to most of the commonly available foods. Key points:

No tracking. No adds. The app doesn’t require network permissions.
Insulin index (II where scientific study available).
Open-source.

Continue reading “GiGl first alpha version available”

Fighting SPAM with postfix and fail2ban

After detecting spammers with an RBL list you can block them for a predefined period of time with the help of fail2ban. How does it work:
– fail2ban parses mail.log
– when a spammer IP is found it is added to a temporary list
– future requests from the spammer’s IP is blocked Continue reading “Fighting SPAM with postfix and fail2ban”

Copy data from bloomberg sft with winscp cmd

It is a little bit tricky to run winscp command. Here is a working example:

connect and authenticate with pre shared key
synchronize all except bin,etc
exit with correct exit code
eventually run powershell script

@echo off
"C:\Path\WinSCP.com" ^
  /log="C:\Path\WinSCP.log" /ini=nul ^
  /command ^
    "open sftp://username@sftp.bloomberg.com/ -hostkey=""ssh-rsa 2048 AA:BB:CC:DD:EE:FF:AA:BB:CC:DD:EE:FF:00:00:00:00"" -privatekey=""C:\Path\bloomberg.ppk""" ^
    "synchronize -filemask=""|/bin/;/etc/""  local ""SFTP"""^
    "exit"

set WINSCP_RESULT=%ERRORLEVEL%
if %WINSCP_RESULT% equ 0 (
  echo Success
) else (
  echo Error
)

powershell -file sync2r.ps1
exit /b %WINSCP_RESULT%

@echo off

"C:\Path\WinSCP.com" ^

/log="C:\Path\WinSCP.log" /ini=nul ^

/command ^

"open sftp://username@sftp.bloomberg.com/ -hostkey=""ssh-rsa 2048 AA:BB:CC:DD:EE:FF:AA:BB:CC:DD:EE:FF:00:00:00:00"" -privatekey=""C:\Path\bloomberg.ppk""" ^

"synchronize -filemask=""|/bin/;/etc/"" local ""SFTP"""^

"exit"

set WINSCP_RESULT=%ERRORLEVEL%

if %WINSCP_RESULT% equ 0 (

echo Success

) else (

echo Error

)

powershell -file sync2r.ps1

exit /b %WINSCP_RESULT%

Testing IO performance with variable block size on NTFS and REFS

Basic command:

diskspd.exe -b64K -d60 -h -L -o2 -t4 -r -w50 -c512M z:\io2.dat

1	diskspd.exe -b64K -d60 -h -L -o2 -t4 -r -w50 -c512M z:\io2.dat

raw data: Continue reading “Testing IO performance with variable block size on NTFS and REFS”

Change local admin password with PowerShell

Change local admin password on multiple machines with PowerShell.

$computers = "srv1","srv2","srv3"
$adminPassword = "PAssW00rrrDdd123"
$logfile = "log.txt"
$ErrorActionPreference = 'stop'
ForEach ($computerName in $computers){
        Try { 
            
             $adminUser = [ADSI] "WinNT://$computerName/Administrator,User"
             $adminUser.SetPassword($adminPassword)

        } 
        Catch { 
            "$(get-date) :: Server:$($computerName) :: $($error[0].exception)" | Out-File -append $logfile                                          
        } 
}

$computers = "srv1","srv2","srv3"

$adminPassword = "PAssW00rrrDdd123"

$logfile = "log.txt"

$ErrorActionPreference = 'stop'

ForEach ($computerName in $computers){

Try {

$adminUser = [ADSI] "WinNT://$computerName/Administrator,User"

$adminUser.SetPassword($adminPassword)

}

Catch {

"$(get-date) :: Server:$($computerName) :: $($error[0].exception)" | Out-File -append $logfile

}

Convert VMDK to VHDX with powershell

Import-Module "C:\Program Files\Microsoft Virtual Machine Converter\MvmcCmdlet.psd1"
ConvertTo-MvmcVirtualHardDisk -SourceLiteralPath C:\Users\milan\Downloads\bitnami-redmine-3.4.2-4-linux-debian-8-x86_64\bitnami-redmine-3.4.2-4-linux-debian-8-x86_64-disk1.vmdk -VhdType DynamicHardDisk -VhdFormat vhdx -destination .\redmine.vhdx

Import-Module "C:\Program Files\Microsoft Virtual Machine Converter\MvmcCmdlet.psd1"

ConvertTo-MvmcVirtualHardDisk -SourceLiteralPath C:\Users\milan\Downloads\bitnami-redmine-3.4.2-4-linux-debian-8-x86_64\bitnami-redmine-3.4.2-4-linux-debian-8-x86_64-disk1.vmdk -VhdType DynamicHardDisk -VhdFormat vhdx -destination .\redmine.vhdx

NextCloud 12 Active Directory nested groups

Insert following query in editor:

(&(objectClass=organizationalPerson)(|(memberof:1.2.840.113556.1.4.1941:=CN=NextCloudUsers,OU=Groups,DC=domain,DC=com)(memberof:1.2.840.113556.1.4.1941:=CN=NextCloudAdmins,OU=Groups,DC=domain,DC=com)))

1	(&(objectClass=organizationalPerson)(\|(memberof:1.2.840.113556.1.4.1941:=CN=NextCloudUsers,OU=Groups,DC=domain,DC=com)(memberof:1.2.840.113556.1.4.1941:=CN=NextCloudAdmins,OU=Groups,DC=domain,DC=com)))

Test it:

root@nc:/home/user# ldapsearch     -x -h 10.40.aa.bbb     -D "user@domain.com"     -W     -b "dc=domain,dc=com"     -s sub "(&(objectClass=organizationalPerson)(|(memberof:1.2.840.113556.1.4.1941:=CN=NextCloudUsers,OU=Groups,DC=domain,DC=com)(memberof:1.2.840.113556.1.4.1941:=CN=NextCloudAdmins,OU=Groups,DC=domain,DC=com)))" cn mail sn

root@nc:/home/user# ldapsearch -x -h 10.40.aa.bbb -D "user@domain.com" -W -b "dc=domain,dc=com" -s sub "(&(objectClass=organizationalPerson)(|(memberof:1.2.840.113556.1.4.1941:=CN=NextCloudUsers,OU=Groups,DC=domain,DC=com)(memberof:1.2.840.113556.1.4.1941:=CN=NextCloudAdmins,OU=Groups,DC=domain,DC=com)))" cn mail sn

Recursively change folder permissions Exchange 2016

$new-user="myusername"
$old-mailbox="old-mailbox"
$folder-name="virus"
ForEach($f in (Get-MailboxFolderStatistics $old-mailbox | Where {$_.FolderPath.Contains($folder-name) -eq $True } ) )
{	
	$fname = $old-mailbox+":" + $f.FolderId;	
	Add-MailboxFolderPermission $fname -User $new-user -AccessRights Owner 
}

$new-user="myusername"

$old-mailbox="old-mailbox"

$folder-name="virus"

ForEach($f in (Get-MailboxFolderStatistics $old-mailbox | Where {$_.FolderPath.Contains($folder-name) -eq $True } ) )

{

$fname = $old-mailbox+":" + $f.FolderId;

Add-MailboxFolderPermission $fname -User $new-user -AccessRights Owner

}

FC Adapter HBA Attributes

Get-WmiObject -class MSFC_FCAdapterHBAAttributes -computername localhost -namespace "root\WMI" | Select-Object DriverVersion, FirmwareVersion, Manufacturer, Model, SerialNumber, ModelDesc
ription, @{expression ={(($_.NodeWWN) | ForEach-Object {"{0:x}" -f $_}) -join ":"};label="WWN"} |Format-Table -AutoSize

Get-WmiObject -class MSFC_FCAdapterHBAAttributes -computername localhost -namespace "root\WMI" | Select-Object DriverVersion, FirmwareVersion, Manufacturer, Model, SerialNumber, ModelDesc

ription, @{expression ={(($_.NodeWWN) | ForEach-Object {"{0:x}" -f $_}) -join ":"};label="WWN"} |Format-Table -AutoSize

Model SerialNumber ModelDescription WWN
----- ------------ ---------------- ---
AJ763B/AH403A 5CF644034W HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:f7:96:54
AJ763B/AH403A 5CF644034W HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:f7:96:55

Model SerialNumber ModelDescription WWN

----- ------------ ---------------- ---

AJ763B/AH403A 5CF644034W HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:f7:96:54

AJ763B/AH403A 5CF644034W HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:f7:96:55

All cluster’s WWN

Invoke-Command -ComputerName  cl2n1,cl2n2,cl2n3,cl2n4,cl2n5 -ScriptBlock {$env:computername;Get-WmiObject -class MSFC_FCAdapterHBAAttributes -computername localhost -namespace "root\WMI"
| Select-Object DriverVersion, FirmwareVersion, Manufacturer, Model, SerialNumber, ModelDescription, @{expression ={(($_.NodeWWN) | ForEach-Object {"{0:x}" -f $_}) -join ":"};label="WWN"} |Format-Table -AutoSize}

Invoke-Command -ComputerName cl2n1,cl2n2,cl2n3,cl2n4,cl2n5 -ScriptBlock {$env:computername;Get-WmiObject -class MSFC_FCAdapterHBAAttributes -computername localhost -namespace "root\WMI"

| Select-Object DriverVersion, FirmwareVersion, Manufacturer, Model, SerialNumber, ModelDescription, @{expression ={(($_.NodeWWN) | ForEach-Object {"{0:x}" -f $_}) -join ":"};label="WWN"} |Format-Table -AutoSize}

CL2N1

DriverVersion FirmwareVersion Manufacturer       Model         SerialNumber ModelDescription                     WWN
------------- --------------- ------------       -----         ------------ ----------------                     ---
11.0.247.8000 2.02X13         Emulex Corporation AJ763B/AH403A 5CF33602NS   HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:XX:YY:ZZ
11.0.247.8000 2.02X13         Emulex Corporation AJ763B/AH403A 5CF33602NS   HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:XX:YY:ZZ


CL2N5

DriverVersion FirmwareVersion Manufacturer       Model         SerialNumber ModelDescription                     WWN
------------- --------------- ------------       -----         ------------ ----------------                     ---
11.1.145.16   2.03X6          Emulex Corporation AJ763B/AH403A 5CF644034W   HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:XX:YY:ZZ
11.1.145.16   2.03X6          Emulex Corporation AJ763B/AH403A 5CF644034W   HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:XX:YY:ZZ


CL2N4

DriverVersion FirmwareVersion Manufacturer       Model         SerialNumber ModelDescription                     WWN
------------- --------------- ------------       -----         ------------ ----------------                     ---
11.1.145.16   2.03X6          Emulex Corporation AJ763B/AH403A 5CF644024S   HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:XX:YY:ZZ
11.1.145.16   2.03X6          Emulex Corporation AJ763B/AH403A 5CF644024S   HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:XX:YY:ZZ


CL2N3

DriverVersion FirmwareVersion Manufacturer       Model         SerialNumber ModelDescription                       WWN
------------- --------------- ------------       -----         ------------ ----------------                       ---
11.1.145.16   2.03X6          Emulex Corporation AJ762A/AH402A 5CF2120587   HP 8Gb Single Channel PCI-e 2.0 FC HBA 20:0:0:0:c9:XX:YY:ZZ
11.1.145.16   2.03X6          Emulex Corporation AJ762A/AH402A 5CF2120583   HP 8Gb Single Channel PCI-e 2.0 FC HBA 20:0:0:0:c9:XX:YY:ZZ


CL2N2

DriverVersion FirmwareVersion Manufacturer       Model         SerialNumber ModelDescription                     WWN
------------- --------------- ------------       -----         ------------ ----------------                     ---
11.1.145.16   2.03X6          Emulex Corporation AJ763B/AH403A 5CF33602P9   HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:XX:YY:ZZ
11.1.145.16   2.03X6          Emulex Corporation AJ763B/AH403A 5CF33602P9   HP 8Gb Dual Channel PCI-e 2.0 FC HBA 20:0:0:90:fa:XX:YY:ZZ

CL2N1