Automator as most of you know, pulls IP and URL information from various sources in order to make analysis easier on the analyst. Recently IPVoid changed up their site a bit, because of this I needed to make some modifications to Automater to get it to function appropriatley. To be specific I needed to modify the regular expressions to match the format of the new site.
I have some other changes that I will be making soon as well:
Extra export options (csv, html)
Malware domainlist checker
Source engine selection
Re-write to utilize BeautifulSoup
If anyone has any other feature requests please let me know.
To see more about what Automater is and how it functions check out the tutorial.
Automater is an IP and URL analysis tool that I created to assist analyst in pulling data quickly and passively in mass. This is the first stable release of the tool.
Features:
IPVoid: Pulls blacklist, ISP, and Geo Location
Robtex: Pulls DNS information. *A records only.
Fortiguard: Pulls URL Categorization
Unshotren.me: Will determine if the URL is shortened. If it is it will display the final destination.
If the IP or URL has not been previously scanned at IPVoid or URLVoid, the script is supposed to submit the IP or URL and then pull results. This seems to work most of the time, but on occasion it will not wait long enough to pull the appropriate result. Running the command a second time will work though.
Can not use the -e and -f switch together.
URLs with http:// cannot be scanned. Must take the http:// out for it to work.
Please submit any other bugs to 1aN0rmus@tekdefense.com
Upcoming Features:
For those who would like to be able to just query a specific engine or source such as robtex, we will be creating an option to do so.
Check IP and/or URL against Malwaredomainlist
Check IP and/or URL against malware sandboxes such as ThreatExpert.
Summary report that will give statistics on the targets highlighting the known bad information such as blacklists and malicious URL categories.
Please submit feature requests to 1aN0rmus@tekdefense.com
One challenge I have faced, as well as seen other analyst face as well is the amount of time it takes to investigate an IP Address or URL. If you are like most analyst you have probably used at least some if not all of the following web tools to investigate IPs or URLs involved in an incident:
As I mentioned previously to lookup an IP against all or even some of these takes more time than it should. Additionally, as they all are formatted differently and have different options, you can not export them in a format that can be attached to a trouble ticket, evidence file, or even an email. Noticing this issue, I attempted to fix it by creating a python program that will scrape the previously mentioned resources to pull out the information relevant to what the analyst needs.
Meet Automater:
The tool currently only queries IPVoid, Robtex, and Fortiguard currently, but I am working on adding modules from all the resources I mentioned earlier in the article. The help option will explain where I am heading with the project, all though I am not quite there yet.
root@bt:~/workspace/Automater# ./Automater.py -h
ONLY -t AND -h WORK CURRENTLY!!
-t: target ip or url. URL must include http://
-s: source engine (robtex, ipvoid, fortiguard)
-a: all engines
-h: help
-f: import a file of IPs and/or URLs
-o: output results to file
-i: Interactive Mode
Examples:
./Automater.py -t 123.123.123.123 -a -o result.txt
Automater right now only takes the -t and the -h options and only works for one target at a time. This again will change as I modify it. URL support has not been added yet either.
I am posting this now in its pre-release form because I would like to hear from the community what types of features they would like to see added. I would also like to know of any bugs you can find. Lastly, I am of course interested in anyone who would like to contribute to the project. If all goes as planned I would like to have the tool fully functional within a couple of weeks. Once complete I will attempt to pitch the tool to Doug Burks to add to his Security Onion Distro. I think this could be a really nice tool for analysts.
Friday, February 8, 2013 at 9:45AM 
