Why use Twitter’s advanced search ?

Twitter's basic search bar often falls short when you're looking for specific information within the vast sea of tweets. This is where advanced search operators come in, offering a way to refine your searches and dig deeper into conversations. By using these operators, you can search for tweets that contain certain words, hashtags, or phrases, or focus on tweets from specific accounts. You can also filter results by language, time period, or even by levels of engagement, such as likes and retweets. These operators are incredibly useful for anyone looking to streamline their research, whether you're trying to track a topic over time, find relevant discussions, or uncover hidden insights from users.

Essential Twitter search operators you should know

To become a power user of Twitter’s search functionality, it’s essential to understand the various search operators that allow you to refine your results. Below are some of the most commonly used operators, along with detailed explanations and practical examples of how you can apply them.

Word or phrase search

Operator: [word/phrase]

This is the most basic search function on Twitter. When you enter a word or phrase in the search bar, Twitter returns all tweets containing that word or phrase. You can enter multiple words or phrases to broaden the search results. It’s important to note that Twitter treats the search as a broad match unless you specify otherwise.

• Example: If you search for weather forecast, Twitter will return all tweets containing both the word "weather" and "forecast", but they don’t necessarily have to be next to each other.

Exact Match Search

Operator: "[exact phrase]"

Sometimes you want to search for an exact match to a phrase, ensuring that the words appear in the exact order you specify. By placing quotation marks around a phrase, you’ll only see tweets containing that precise sequence of words. This is useful for finding discussions that refer to specific terms or phrases.

• Example: Searching for "olympic medal count" will only return tweets where that exact phrase appears. This operator is great for finding highly targeted and relevant results without dealing with variations or reworded phrases.

Exclude words

Operator: -[word]

Sometimes you may want to exclude certain words from your search results. By adding a minus sign (-) before a word, you instruct Twitter to omit tweets that contain that word. This is particularly useful when a keyword is associated with different topics or contexts that you’re not interested in.

• Example: If you’re interested in tweets about "social media" but want to exclude tweets about "facebook", you would search for social media -facebook. This will show all tweets mentioning a world cup, but none that include the word "facebook".

Hashtag search

Operator: #[hashtag]

Hashtags are one of the most iconic features of Twitter, making it easy to follow conversations or trends centered around a particular topic. When you search using a hashtag, Twitter returns all tweets that have been tagged with that specific hashtag.

• Example: Searching for #Olympics will bring up all tweets containing the #Olympics hashtag, making it easy to find motivational tweets that are specifically related to that trend.

From specific account

Operator: from:[username]

If you want to see all tweets from a specific Twitter user, this operator will narrow down your search results to only show tweets that were posted by that account. This is especially useful for tracking updates from brands, influencers, or public figures.

• Example: from:OpenAI will show you all tweets sent from the @OpenAI account. This operator is a great way to filter out noise and focus solely on content from a particular user.

To specific account

Use this operator to find tweets directed to a specific account. It’s useful for seeing what people are saying to a particular person or brand. This operator only returns tweets that start with the user's handle (i.e., direct replies or mentions).

• Example: If you search to:elonmusk, you’ll see tweets sent directly to Elon Musk’s account. This can help you follow conversations or see feedback and questions people are sending to a certain user.

Mentioning specific account

Operator: @[username]

Want to see all tweets where a specific user is mentioned? This operator shows any tweets that include a particular @username anywhere in the text (not just replies).

• Example: Searching for @NASA will return tweets that mention the @NASA account, whether it’s in a reply, part of a discussion, or simply tagged in a conversation.

Search within a date range

Operator: since:[yyyy-mm-dd] until:[yyyy-mm-dd]

Twitter allows you to filter tweets based on the date they were posted. This is incredibly useful if you’re trying to research tweets related to an event or trend within a specific timeframe. The since operator specifies the starting date, and the until operator specifies the ending date.

• Example: Searching for #Olympics since:2024-07-26 until:2024-08-11 will return tweets using the #Olympics hashtag within the specified date range. This operator is perfect for historical research or tracking trends during specific periods.

Filter by URL

Operator: url:[domain or URL fragment]

This operator allows you to find tweets that include a specific URL or domain. Whether you’re tracking how often a link to a particular article or website is shared, this operator helps you identify tweets containing that link or any part of a domain. It’s great for researching how widely a certain webpage is being referenced or shared across the platform.

• Example 1: Searching for url:nytimes.com will return tweets containing any link from The New York Times website.

• Example 2: If you want to find tweets sharing a specific article, you can use part of the URL, such as url:openai.com/blog/gpt-4.

Filter by media type

Operators: filter:media, filter:images, filter:videos

Sometimes, you want to search for tweets that contain media, such as photos, videos, or any other multimedia content. Twitter's media filters allow you to narrow your search to tweets that specifically include media, images, or videos. These filters are perfect for when you're looking for visual content or media-related discussions.

• filter:media: This operator shows tweets containing any form of media, including images, videos, and GIFs.

  • Example: #Olympics filter:media will return all tweets using the hashtag #Olympics that contain some form of media (images, videos, or GIFs).

• filter:images: This operator focuses specifically on tweets containing images.

  • Example: from:NASA filter:images will show all tweets from the NASA account that include images, making it easy to find their visual content like space photos or mission updates.

• filter:videos: This operator narrows down results to tweets containing videos.

  • Example: cute cat filter:videos will return tweets mentioning "cute cat" that contain videos, allowing you to quickly find video content related to that topic.

Filter by language

Operator: lang:[language code]

Twitter is a global platform, and people tweet in numerous languages. If you’re interested in finding tweets written in a specific language, the lang: operator is your go-to tool. By specifying the language code, you can filter your search results to show only tweets written in that particular language.

• Example: Searching for #Olympics lang:en will return only tweets that contain the hashtag #Olympics and are written in English (using en as the language code). This operator is extremely useful for narrowing your results based on language, particularly when researching topics that are discussed internationally.

Filter by engagement

Operators: min_retweets:[number], min_faves:[number], min_replies:[number]

If you’re interested in finding tweets that have received a certain level of engagement (in terms of retweets, likes, or replies), these operators allow you to set minimum thresholds. This is helpful for discovering popular tweets that have gained significant attention.

• Example 1: #Olympics min_retweets:500 will return tweets containing the hashtag #Olympics that have been retweeted at least 500 times. This allows you to focus on the most popular and widely shared content.

• Example 2: min_faves:1000 will filter for tweets that have received a minimum of 1,000 likes, helping you identify content that has resonated well with the audience.

Search for specific sentiment

Operators: :), :(

Twitter lets you filter tweets by sentiment, using smiley face (:)) or frowny face (:() operators. These are simple yet effective ways to find positive or negative sentiments within tweets. Although basic, this operator can help gauge the general mood or sentiment around a topic.

• Example: Searching for from:Apple :) will return tweets posted by the @Apple account that have a positive sentiment or contain words that are generally perceived as positive.

Adding boolean operators to your Twitter search toolkit

In addition to Twitter's dedicated advanced search operators, Boolean operators - AND, OR, and NOT - offer even more flexibility for tailoring your searches. These logical operators can help you combine or exclude terms to refine results further and filter tweets based on specific conditions.

Let’s break down each of these Boolean operators and how you can use them in your Twitter search queries.

AND operator

Operator: (implicit, no need to type "AND")

By default, Twitter assumes an AND relationship between multiple terms in a search query. This means it will return results containing all of the specified words, phrases, or hashtags.

• Example: coffee music morning finds tweets containing all three words: "coffee," "music," and "morning."

While Twitter automatically assumes an AND between words, combining this logic with other operators allows you to filter more effectively.

OR operator

Operator: OR

Use the OR operator to search for tweets containing any one of the listed words or phrases. This is great for finding tweets related to several different topics or synonyms.

• Example 1: coffee OR tea finds tweets containing either "coffee" or "tea."

• Example 2: #Apple OR #Samsung finds tweets containing either the #Apple or #Samsung hashtags.

NOT operator

Operator: NOT or -

The NOT operator allows you to exclude specific terms or phrases from your search results. It functions similarly to the minus (-) operator, helping filter out irrelevant tweets.

• Example 1: technology NOT AI finds tweets about technology that do not mention AI.

• Example 2: social media -Facebook finds tweets about social media but excludes any tweets mentioning Facebook.

Key points to remember

When using Boolean operators on Twitter, it's essential to remember that Twitter's search functionality is case-insensitive, meaning that "OR" is treated the same as "or." To ensure clarity in your queries, using parentheses to group terms is crucial, as this helps Twitter process the search in the correct order.

Final tips for crafting the ultimate search queries

Combining advanced search operators on Twitter opens up a realm of possibilities that go well beyond basic keyword searches. By carefully crafting your queries with multiple operators, you can hone in on exactly the information you need. Start by experimenting with simple combinations of operators and review the results to see how they align with your goals. Once you get a sense of what works, gradually introduce additional operators to refine and narrow your search.

Additionally, you can mix Boolean operators with Twitter’s advanced search commands for highly customized results. This flexibility allows you to combine multiple concepts, filter results more effectively, and uncover the precise information you need.

Being specific with your search terms is crucial. Exact phrases often yield more precise results than broad keywords, so use quotation marks to search for specific phrases rather than single words. Filtering by date is another effective strategy, especially if you’re interested in conversations related to specific events or time periods.

Ultimately, mastering these advanced search techniques allows you to sift through the vast amount of information on Twitter with remarkable precision. With practice, you’ll be able to craft queries that reveal valuable insights and uncover relevant conversations tailored to your needs.

Bonus tip: Using Twitter’s advanced search page

If typing in search operators feels daunting, Twitter offers an Advanced Search Page that allows you to input your desired criteria into a more user-friendly form. Here, you can easily search for keywords, accounts, dates, and engagement levels without needing to remember the syntax.

To access Twitter's advanced search page, go to: Twitter Advanced Search.

How to use the Wayback Machine?

Input the web page URL

Access the Wayback Machine and enter the full URL of the website you’re interested in into the search bar. Make sure to include the complete address, such as https://www.example.com, to ensure accurate results.

Review available snapshots

You will be redirected to a results page displaying a timeline and a calendar view. The timeline is positioned at the top of the page and shows a range of years, while the calendar view below it highlights specific dates when snapshots of the web page were taken. These snapshots represent different points in time when the page was archived.

Choose a specific date

To find the version of the web page you are interested in, click on a date shown in the calendar or select a point on the timeline that corresponds to a time when the page was archived. If multiple snapshots are available for the same day, you might need to explore various dates or times to locate the exact version you are seeking.

Examine the archived page

After selecting a particular date, you will be taken to the archived version of the web page as it appeared on that chosen day. You can interact with the archived page, navigating through its content just as you would with a live page.

Tips for effective use of the Wayback Machine

Use multiple dates

If the initial snapshot you access seems incomplete or missing certain elements, consider checking snapshots from various dates. Different dates might offer more complete or better versions of the content you are searching for, as the Wayback Machine may have archived multiple iterations of the page.

Check different years

If the page was deleted some time ago, it may have been archived sporadically over the years. To increase your chances of finding the version you need, extend your search across different years. The Wayback Machine archives pages over a broad timeline, so exploring various years might help you locate the most relevant snapshot.

Utilize the Internet Archive’s search functionality

If you don’t have the exact URL of the deleted page, you can use the Internet Archive’s search functionality to assist in finding it. On the Internet Archive’s website, use the search feature to look for the site in question. This allows you to browse through indexed pages and historical captures to locate the specific content you’re interested in.

Other methods to retrieve deleted pages

Using Google cache

Google stores a cached version of web pages it indexes. This cache can often be accessed even after the page has been deleted.

To access Google Cache, follow these steps:

First, search for the page on Google by entering the URL or title of the deleted page into Google's search bar. In the search results, find the cached link by clicking on the small downward arrow next to the URL and selecting "Cached" if it is available. Google will then display a cached version of the page as it appeared when last indexed.

If the "Cached" option isn't visible, you can try the following URL format:

http://webcache.googleusercontent.com/search?q=cache:<URL>

Replace <URL> with the full URL of the deleted page.

Using other web archives

Apart from the Wayback Machine, other web archiving services may have captured the page you are looking for. One such service is archive.is, which provides snapshots of web pages and can be useful for retrieving content that might not be available through the Wayback Machine. To use this service, simply visit their website and enter the URL of the page you want to find.

Most organizations follow standardized patterns when creating email addresses for their employees. Recognizing these patterns can give you a head start in guessing an email address correctly. Here are the most common email address patterns you’re likely to encounter:

• first.last@domain.com (e.g., john.doe@example.com)

• firstlast@domain.com (e.g., johndoe@example.com)

• first_last@domain.com (e.g., john_doe@example.com)

• first_initiallast@domain.com (e.g., jdoe@example.com)

• fisrtlast_initial@domain.com (e.g., johnd@example.com)

• last@domain.com (e.g., doe@example.com)

• first@domain.com (e.g., john@example.com)

By understanding these patterns and considering possible variations, you can significantly narrow down the potential email addresses for the person you’re trying to reach.

Using email permutation tools

After understanding the common email patterns, the next step is to generate all possible combinations of email addresses for a given name and domain. This is where email permutation tools come in handy. These tools automate the process of creating potential email addresses based on the patterns you’ve identified, saving you time and effort.

Some popular email permutation tools include:

• Email Permutator+: This is a Google Sheets add-on that generates email permutations based on input.

• Hunter.io: Besides generating email permutations, it also offers verification services.

• Voila Norbert: This tool is great for both email guessing and verification.

Verifying the email address

Once you have a list of potential email addresses, the next crucial step is to verify them. Verification ensures that the email address exists and is capable of receiving emails, reducing the risk of bounce backs and protecting your sender reputation. Here’s how you can effectively verify email addresses.

Verification is important to avoid bounce backs and improve response rates. Sending emails to invalid addresses can result in high bounce rates, which can damage your email sender score and negatively impact future deliverability. Additionally, using verified email addresses increases the likelihood that your emails will reach the intended recipients, thereby enhancing your chances of receiving a response.

Here are some tools to check if an email address is valid:

• Hunter.io email verifier: Checks the deliverability of an email address.

• NeverBounce: Provides detailed validation results.

• ZeroBounce: Offers a range of email validation services including identifying invalid and risky email addresses.

• MailTester.com: A quick way to verify the existence of an email address.

Protecting your own email address from unwanted exposure

While the ability to find someone's email address can be advantageous, it’s equally important to protect your own email address from being easily discovered and potentially misused. Here are some detailed tips to safeguard your email:

1. Use email aliases

Use email aliases by creating different email addresses for various purposes. For personal use, have one email for friends and family. Use a professional email address for work-related communications, and separate emails for subscriptions, online shopping, or forums. This compartmentalization reduces the risk of exposure. Some email providers, like Gmail, allow you to create aliases by adding "+something" to your email address (e.g., john.doe+shopping@gmail.com).

2. Use disposable email addresses

For temporary or one-time use, consider using disposable email addresses. Services like TempMail, Guerrilla Mail, or Mailinator are ideal for signing up for services that might send spam, protecting your primary email from spam and potential data breaches. Disposable emails are perfect for short-term needs and help keep your primary inbox clean.

3. Be cautious with public email sharing

Be cautious with public email sharing. Avoid displaying your primary email address in public forums and on social media. Instead, use a secondary or disposable email for public sharing. If you run a website or blog, use contact forms instead of listing your email address. This helps keep your primary email address private and secure.

4. Monitor for data breaches

Monitor for data breaches by staying informed about compromised accounts. Use services like Have I Been Pwned to check if your email address has been involved in a data breach. If your email appears in a breach, immediately change your password and enable two-factor authentication (2FA). Regular monitoring helps you take swift action if your information is compromised.

5. Educate yourself about phishing

Educate yourself about phishing to recognize and avoid phishing attempts. Do not click on links or open attachments from unknown or unsolicited emails. Be cautious of emails that create a sense of urgency, ask for personal information, or seem too good to be true. Understanding how to identify phishing attempts can prevent you from falling victim to scams.

Shortened links are URLs that have been condensed into a shorter format. This is typically achieved through URL shortening services such as Bitly, TinyURL, or goo.gl. These services take a long URL and convert it into a short, manageable link that redirects to the original address.

Why are shortened URLs used?

Shortened URLs are used for several reasons. They offer convenience as they are easier to share, particularly on platforms with character limits such as Twitter. They also enhance aesthetics, providing a cleaner and more professional appearance in communications. Additionally, URL shortening services often come with tracking and analytics features, allowing users to monitor the number of clicks, the geographical location of the clicks, and other data.

The role of shortened links in OSINT

In OSINT, shortened links can be a treasure trove of information. Cybersecurity analysts and investigators often encounter these links in various contexts, such as social media posts, emails, forums, and more. By analyzing these links, investigators can gain insights into user behavior, identify potential threats, and uncover hidden connections.

Investigators can trace the original sources of information or communications and identify patterns in behavior or information dissemination. Additionally, OSINT can help unmask malicious links that are often disguised using shortened URLs, thus protecting against cyber threats.

How to track shortened URLs

Tracking shortened links involves several steps and tools. Here’s a step-by-step guide:

Unshortening the link

The first step is to reveal the original URL behind the shortened link. This can be done using unshortening services like CheckShortURL, Unshorten.It, or directly through some URL shortening service providers that offer preview options.

• CheckShortURL: This tool allows you to see the full URL and its safety status.

• Unshorten.It: Another service that reveals the original URL along with a screenshot of the destination page.

• Manual method: For some URL shortening services, you can simply add a "+" at the end of the shortened URL to see more details. For example, adding "+" to a Bitly or goo.gl link (https://bit.ly/3SDO9ZM+) will show you the original URL and analytics data if available. For TinyURL, type "preview": https://preview.tinyurl.com/.

Analyzing the original URL and gathering metadata

Once the original URL is revealed, it can be analyzed for further information. This may involve looking at the domain, checking for known malicious activity, or seeing if the URL leads to a suspicious or unexpected site. Tools like URLscan.io, VirusTotal, and WHOIS lookups can provide valuable metadata about the domain, such as the registrar, registration date, associated IP addresses, and any reported malicious activity.

• WHOIS lookup: Use WHOIS services to find out who registered the domain and their contact information.

• Website analytics tools: Tools like SimilarWeb or Alexa can provide insights into the website’s traffic and engagement.

• Social media analysis: Look for mentions of the URL on social media platforms to understand its spread and impact.

I am starting this adventure as a novice, and I plan to document every step of my journey on this blog. My goal is to understand the fundamentals of OSINT, discover the best tools and techniques, and apply this knowledge to concrete projects. Through this blog, I will share my discoveries, successes, and mistakes, with the hope of helping other beginners follow the same path.

I am very enthusiastic about sharing this journey with you and hope you find this blog both useful and inspiring. Whether you are a novice like me or an OSINT expert, your feedback and advice are welcome.