Is Anyone Using Python Asyncio with SWQL?

brianbooher

I have a script that scans all my switches and routers for interfaces, and then adds them to Solarwinds based on my criteria.

Since I have almost a 1000 devices, my synchronous script takes days to complete.

Seems like a job for some sort of multiprocessing feature. 

In reading about Asyncio, that looks like this is the right tool for the job since my script spends most of it's time waiting for Solarwinds to query devices for a new list of interfaces.

But it also looks like Asyncio works only with libraries that support Asyncio.

Has anyone used this in their Python SWQL scripts? Would you share your code?

-Brian

brianbooher

I figured it out. I used a wrapper around the function I use to tell Solarwinds to scan nodes. What used to take days now takes less than an hour.

Wrapper is to run Netmiko commands on a bunch of devices but you can use the same syntax and substitute your own SWQL function for the Netmiko one:

import asyncio
from netmiko import ConnectHandler

# Device details
devices = [
{"device_type": "cisco_ios", "host": "10.1.1.x", "username": "admin", "password": "password"},
{"device_type": "cisco_ios", "host": "10.1.1.x", "username": "admin", "password": "password"},
{"device_type": "cisco_ios", "host": "10.1.1.x", "username": "admin", "password": "password"},
]

# Function to execute a command on a single device
def run_command(device, command):
connection = ConnectHandler(**device)
output = connection.send_command(command)
connection.disconnect()
return output

# Wrapper for asyncio to run the blocking function in a thread
async def async_run_command(device, command):
return await asyncio.to_thread(run_command, device, command)

# Main function to run commands in parallel
async def run_in_parallel(devices, command):
tasks = [async_run_command(device, command) for device in devices]
results = await asyncio.gather(*tasks)
return results

# Run the commands
if __name__ == "__main__":
command = "show ip interface brief"
result = asyncio.run(run_in_parallel(devices, command))
for i, device_result in enumerate(result):
print(f"Result from {devices[i]['host']}:\n{device_result}\n")