OSINT TOOLS 2023
(Part 1)
More than 600 links and tools for
Open Source INTelligence and information retrieval.
TABLE OF CONTENTS
-
Privacy-oriented search engines
Keyword research tools.
-
One Look: Enter a word, phrase, sentence, or pattern to search for related words.
-
Ubersuggest: suggest keywords not available in the Google Keyword Planner.
Browser extensions for OSINT.
-
Double Shot Search is an extension for Chrome that doubles the search. It searches in two search engines simultaneously - Bing and Google.
-
Hunter.io is a service that will find e-mail addresses associated with a certain domain. You can also use this tool to find an e-mail address by name in a couple of seconds.
-
RevEye is an open-source Chrome extension that runs a photo through Google, Bing, Yandex and TinEye.
Search Engines.
General Search
-
Google Bing Yahoo AOL Infospace Lycos Exalead ASK Ecosia entireweb teoma yippy
-
I Search From: simulate using Google Search from a different location or device, or perform a search with custom search settings.
-
millionshort: Allows you to remove the top of the search engine results (e.g Remove top 100,1000,10000)
National Search Engines.
Privacy-oriented search engines
-
DuckDuckGo: Online investigators usually use it to search the surface web while using the Tor Browser.
-
Startpage: Fetch results from Google without tracking its users.
-
Peekier: Privacy oriented search engines that fetch its results using its own search algorithm.
-
Qwant: Based in France.
-
Oscobo: Based in UK.
-
Swisscows: Privacy safe WEB-search based in Switzerland.
-
Gigablast: Open source search engine.
-
Gibiru: Uncensored and anonymous search engine.
Meta search engines
-
etools: Compile its results from major international search engines, keep user privacy by not collecting or sharing personal information of its users. This search engine is very fast and show a summary for each search query -on the right side- detailing the source of its results.
-
All the interne: query major search engines including shopping site like Amazon and eBay.
-
izito: Aggregate data from multiple sources (Yahoo, Bing, Wikipedia, YouTube and other) to generate optimal results which includes images, videos, news and articles.
-
Metacrawler: Aggregate results from Google and Yahoo!.
-
My all search: Aggregates results through Bing, DuckDuckGo, AOL Search, Ask, Oscobo, Mojeek, ZapMeta, MetaCrawler.
-
Carrot2: Open Source Search Results Clustering Engine aggregate results from GoogleAPI, Bing API, eTools Meta Search, Lucene, SOLR, and more.
-
elocalfinder: Fetch results from Google, Yahoo!, Ask and Bing .
Image Search Engines
Google image search Bing image search Yahoo images Yandex images Baidu images Imgur Photobucket Picsearch creativecommons Smug mug
There are specialized sites that hold images appeared in the press and news media, to search for this type of images go to:
-
Gettyimages: Contains images from news, entertainment, fashion, sports and archival imagery.
Images shared across social media sites can be found in the following locations:
-
idGettr: Find Flicker ID number (also works for groups).
-
Flickr Hive Mind: Data mining tool for the Flickr database of photography.
-
Stalkture: Instagram Online Web Viewer.
There are specialized sites that hold images appeared in the press and news media, to search for this type of images go to:
-
Cam finds App: this is an App available for both Android and Apple devices. It uses visual search technology to recognize uploaded picture and give instant results about it like related images, local shopping results and a vast selection of web results.
Stock photo search:
Video Search Engines
-
Geo Search Tool: Search for all movies according to a specific query entered by the user – the result set will be further filtered according to the distance from a specific location (city, village, intersection) and according to a specific time frame (past hour, past two or three hours ..etc.).
Fake News Detection.
-
Snopes: Discovers false news, stories, urban legends and research/validate rumors to see whether it is true.
-
Hoaxy: Check the spread of false claims (like a hoax, rumor, satire, news report) across social media sites. The site derives its results from reputable fact checking organizations to return the most accurate results.
-
FactCheck: This site is partnered with Facebook to help identify and label fake news reported by its users. It also monitors different media for the false info covering a wide range of topics like health, science, hoaxes spread through Spam emails.
-
ReviewMeta: Analysis Amazon user reviews.
-
Reporter Lab: Gives a map of global fact-checking sites.
-
Truth Or Fiction: Discover fake news in different topics like politics, nature, health, space, crime, police and terrorism…etc.
-
Hoax-Slayer: Focuses on email scam and social media hoaxes.
-
Verification Handbook: A definitive guide to verifying digital content for emergency coverage available in different languages.
-
Verification junkie: This is a directory of tools for verifying, fact checking and assessing the validity of eyewitness reports and user self-published content online.
-
citizen evidence: tools and lessons to teach people how to authenticate user-generated online contents. Managed by Amnesty International.
News/Newspaper Search Engines.
-
1stHeadlines: Breaking news headline.
-
Newspaper Archives: Contains Newspaper Archives 1607-2017 and Obituaries & Family History Records.
-
Findmypast: US and world historical( China, Denmark, France, Germany, Jamaica, and South Africa are also searchable within the collection) Newspaper archive.
-
Newsography: International relations and armed conflicts global news aggregator and historical database.
-
Online Newspapers: Online Newspaper Directory for the World.
-
YouGotTheNews: Search Engine for US News – Search thousands of national, business, and local news sources.
-
Library of Congress Newspapers directory & 100 Years Ago Today: Search U.S. Newspaper Directory, 1690-Present using these two links from the Library of Congress.
Patent Search Engines
-
State Intellectual Property Office (SIPO) of the People’s Republic of China
-
stopfakes: The International Trade Administration (ITA), U.S. Department of Commerce, manages STOPfakes.gov to assist U.S. businesses protect and enforce their intellectual property rights against counterfeits and pirated goods in the global marketplace.
-
FreePatentsOnline: Patent metadata search engine.
Business Search
Business Profiles
-
Open corporates: The largest open database of companies in the world.
-
Zoom info: List companies in the U.S categorized by industry and offer information
-
corporationwiki: Allows you to search for any company and visualize the connection between people working within it
-
Kompass: This is a global B2B portal with information about companies in more than 60 countries.
-
Manta: Business directory for U.S businesses
-
LittleSisThis is a powerful profiling website that lists a wealth of information about 185,000 people and 67,000 organizations in varying stages of completion.
Business Annual Records
-
Annual Reports: Lists thousands of annual records from 5,333 companies worldwide.
-
Reporter Link: Contains more than 60 Million searchable tables, figures and datasets.
-
Company registration around the world: Give a list of government, commercial registers websites around the globe.
Data Leak Websites
- GlobaLeaks: is an open-source, free software intended to enable secure and anonymous whistleblowing initiatives
-
Have I Been Facebooked? : Check if your data was part of the Facebook April 2021 breach.
-
Have I Been Zucked? : Check if your details are included in the 2019 Facebook data breach.
Pastebin sites
Social Media Intelligence
Facebook
-
Facebook scanner: As of June 6th, you can scan only your own profile with this tool.
-
Socmint: Facilitate fetching information using Facebook Graph search.
-
Lookup ID: Find Facebook personal numeric ID / Group ID / Page ID.
-
FindMyFbid: Locate Facebook personal numeric ID.
-
LikeAlyzer: Analyze and monitor Facebook Pages.
-
Face Live: Facebook live video search.
-
Who posted what?: Facebook keyword search generator. It searches Facebook posts and limit the results to specific date.
-
ExtractFace: Automate extracting data from Facebook profiles (Not working currently).
Twitter
-
All My Tweets: View all public tweets posted by any Twitter account on one page.
-
Trendsmap: Shows you most popular trends, hashtags and keywords on Twitter from anywhere around the world.
-
Foller: Analysis Twitter account (profile public information, number of tweets and followers, topics, hashtags, mention).
-
First Tweet: Find the first tweet of any search keyword or link.
-
Social bearing: Analysis twitter accounts.
-
Sleeping Time: Predict the sleeping schedule of anyone on Twitter.
-
Simple Twitter Profile Analyzer (Python script).
-
Tag board:Search for hashtags on Twitter, Facebook & Google+.
-
Spoonbill: Monitor profile changes from the people you follow on Twitter.
-
Export Tweet: Advanced Twitter analytical service, you can download the generated report for off-line usage. To unlock full features, you need to pay.
LinkedIn
-
LinkedIn Scraper: Scrapes Any LinkedIn Data
-
Lisearcher: Easily find public LinkedIn profiles for candidates or B2B prospects in Google by searching using job title and keywords with boolean search.
-
picodash: A powerful search engine to explore Instagram & Twitter photos, videos, users and locations.
Reddit
-
reddit-user-analyser.netlify.app: Analyse a Reddit user
-
resavr: Reveal Deleted Reddit Comments
-
redditsearch: Advanced Reddit search
-
karmadecay: Reverse image search of Reddit.com (beta)
-
Redective: The Reddit Search Detective
-
Mostly Harmless: looks up the page you are currently viewing to see if it has been submitted to reddit.
-
Reddit Enhancement Suite: A Google Chrome Add-on.
-
reddit investigator: Investigate Reddit users.
-
reddit metrics: a tool for tracking statistics of reddits users and discovering the fastest growing communities on reddit.
-
atomiks: Analyse a Reddit user.
-
SnoopSnoo: Get insights on any reddit user activity.
-
Reddit Comment Search: Search through comments of a particular reddit user.
Social Media Psychological Analysis
-
Tone Analyzer: This is an online service that offers free linguistic analysis to detect human feelings -like joy, fear, sadness, anger, analytical, confident and tentative tones- found in text – like Tweets, emails and Facebook messages.
-
Watson Tone Analyzer: This is a cloud based server created by IBM, it analyzes emotions and tones in online contents (e.g. Facebook posts, reviews and Tweets) to predict the emotional status of the writer. This service can be used in different scenarios -other than intelligence- like detecting customers tones to understand their needs or to better serve them.
-
Fake Sport: This site analyzes Amazon, Yelp, TripAdvisor and Apple App store users reviews to check The credibility of these reviews.
-
Review Meta: Investigate user reviews on Amazon to check which one is likely to be fake or misleading.
People Search
General People Search Engines
-
Truth finder: TruthFinder has a huge database of social media profiles, address history, contact information, public records (federal, country and state data sources) and other commercial sources, you can search using target first and/or last name in addition to city/state where he lives or lived before.
-
411: Search for people within the United States, search parameter includes Full name, location, reverse phone lookup, email and business.
-
People Smart: Search for people using thier name, phone, address or email.
-
Zaba Search: Find people in the USA using name or phone number.
-
White Pages: Search for people within the USA using their name, phone number, business or address.
-
Been Verified: Search for people within USA using their name, phone, email or mailing address.
-
Address Search: Search for someone email or mailing address using his name and location, the service is limited to the United States only.
-
Lullar: Search social media websites using target email address or first & last name or username.
-
Anywho: Finding people , places and businesses. You can search by name, address or phone number.
-
intelius: People search and phone number lookup.
-
Snoop Station: Search for people using full name and location. Commercial service.
-
Cubib: Search millions of online data records for free. Aggregated data is derived from people search, marketing data, property records, vehicle records, court records, patents, business registration, domain name registration, and white house visitation records.
-
Sorted By Name: A list of links to genealogy details -based on the first letter of the person’s surname- mentioned on other websites.
Online Registries
-
The Knot: Find a couple’s wedding registry and website.
-
Registry Finder: Search for registries.
-
My Registry: Global online gift registry service.
User Name Check
-
Check user name: Check the use of a specific username on 160 Social Networks, very useful to discover target social media accounts if he/she was using the same username on multiple platforms.
-
Namechk: Check to see if a specified username is used for major domain names and social media sites.
-
Namecheckr: Check domain & social username availability across multiple networks.
-
User Search: Scan 45 popular social media websites.
Email Search
Email validation services. This service checks whether an email address exists or not and gives other detailed technical information about it.
-
Email Permutator+: useful to guess the possible combination of the email account of the target.
-
Email Dossier: Give detailed technical validation report about emails.
-
Email Checker: Verify whether an email address is real.
-
Email Header AnalysisGet detailed technical information extracted from email headers, this includes sender IP address, email, sender ISP in addition to Geographical information.
Phone Number Search
-
Z lookup: International reverse phone lookup including cell phones.
Employee Profile
-
Recruit in: A third party website that use Google to search the profiles on LinkedIn. This return deeper results compared to LinkedIn.
-
Byte: Popular Middle east job website.
-
Xing: Business networking site
Government Records
Vital Records
These are government records usually created by local authorities, it includes birth and death records, marriage licenses and divorce decrees
-
genealogybank: Genealogy Records found in Newspapers such as: Birth Announcements, Engagements, Marriage, Anniversary & Divorce Records, Obituaries, Legal Notices, Family Reunions, Military Records
Passenger Lists, Photographs & Images, Shipping & Shipping Records, Community News Articles and more! -
Sorted By Birth Date: This site uses the Death Master File as of 1 March 2014.
-
U.S., Department of Veterans Affairs BIRLS Death File, 1850-2010
-
National Records of Scotland: Links to Births, Deaths and Marriage government records
in Scotland and selected countries like USA and Canada.
Criminal & Court Records
-
SpotCrime: Show a map of crime hot spots for hundreds of different cities around the United States.
-
The Inmate Locator: List inmate locator services in the United Sates.
-
National Criminal Justice Reference Service: This is federally funded resource offering justice and drug-related information to support research, policy, and program development worldwide.
Property Record
-
Zillow: Offers buying, selling, renting, financing, remodeling properties in the United States.
Tax & Financial Records
-
United States Public Records Online Directory: Contain links to official States Websites Public Databases including US citizens’ public tax records.
Social Security Number Search
-
SSN Check: Reverse Social Security Number Lookup (For USA only).
-
SSN-Verify: Social Security Number search and lookup tools.
Other Public Records
There are other types of online public records that can prove useful in some cases.
-
Search Systems: Public records search engine; it includes links to premium databases (require payment).
-
Federal Election Commission: List Individual contribution made by individuals, Native American tribes, partnerships, sole proprietorships, limited liability companies (LLCs) and contributions by the candidate to all political committees.
-
Follow That Money: How money spent in Federal elections.
-
Political Money Line: Track money spent in politics.
Local libraries in USA offer access to proprietary databases like ReferenceUSA (huge directory service) and America’s Newspapers (full-text obituaries) for a small fee. In many instances, such services can be offered remotely in exchange for a valid library subscription card.
Technical Footprinting
Website history
-
Cached pages:Show previous websites capture on three different archive websites (Google cache, Coral, Archive.org).
-
CachedView: The Google Cache Browser for any page on the Internet.
-
Way backpac (Tool): This is a tool that allows you to download the entire Wayback Machine archive for a given web page.
-
WebCite: Only archive history is avaiable.
-
oldweb.today: Retrieve archived web pages from the different public internet archives. You can also display archived websites using different web browsers.
Website monitoring services
Alert services
-
Update Scanner:A Firefox extension that Monitors web pages for updates.
RSS Tools And Services
Websites mirroring tools
-
HTTrack: Copy website for offline view.
-
GNU Wget: Retrieve files using HTTP, HTTPS, FTP and FTPS internet protocols.
-
BlackWidow: Download complete site or part of it and can download any kind of files- including YouTube videos embedded within it.
Link extractor
-
Link Gopher: This is a Firefox add-on that extracts all links from web pages, including the embedded one and display them in a new web page.
Check target website backlinks
-
To see all linked websites to a specific domain name, type the following in Google: site:* darknessgate.com (There should be a space between the asterisk and the domain name).
Identify technologies used
-
Built with: Give detailed technical information about the technology used to build target website.
-
dnslytics: To Find domains sharing the same Google Analytics ID.
IT devices Default Credentials
Vulnerabilities Database
Web Scraping Tools
-
Common Crawl: maintain an open repository of web crawl data that can be accessed and analyzed by anyone.
-
theHarvester: This is a tool for gathering subdomain names, e-mail addresses, virtual hosts, open ports/ banners, and employee names from different public sources like: Google, Bing, LinkedIn, Twitter, Yahoo, pgp and more.
-
Web data extractor (Commercial Application): Collect various data types including URLs, phone and fax numbers, email addresses, as well as meta tag information and body text.
-
80legs: (Commercial) Web Scraping Tools and Cloud-Based Web Crawling.
-
agenty: Cloud-based agents for data scraping, text extraction, ocr, categorization, change detection, sentiment analysis and more…
-
Anthracite: is a collection of Web mining power tools combined in an easy-to-use graphical environment that lets users quickly and seamlessly extract data from Internet sources, modify it to suit their needs, and export it to templates or databases, e.g. for RSS feeds.
-
apify: is a web scraping and automation platform for developers.
-
artoo.js: is a piece of JavaScript code meant to be run in your browser’s console to provide you with some scraping utilities.
-
scrapy:An open source and collaborative framework for extracting the data you need from websites.