← All repositories

twitterthe-algorithm

The Algorithm

Features

  • Content Discovery AlgorithmsGenerate candidate Tweets from outside a user's network by traversing engagement graphs to identify relevant content and similar user interests.
  • Content Ranking ModelsPredict the relevance of candidate Tweets using a neural network trained on interaction data to score and rank content for the timeline.
  • Social Feed Ranking AlgorithmsRetrieve relevant Tweets from a user's network by ranking them with a logistic regression model based on engagement likelihood between users.
  • Timeline Construction ServicesConstruct and serve personalized content timelines by coordinating candidate sourcing, ranking models, and visibility filtering services to process user interaction data.
  • Candidate Sourcing PipelinesA multi-stage retrieval architecture that aggregates content from diverse social graphs and embedding spaces before final ranking.
  • Neural Ranking ModelsA deep learning scoring system that predicts user engagement probabilities by processing interaction features through multi-layer neural architectures.
  • Recommendation Engine PipelinesA distributed architecture that orchestrates candidate sourcing, neural network ranking, and heuristic filtering to deliver personalized content feeds.
  • Model Serving EnvironmentsA high-performance execution environment that deploys predictive models to score content relevance and user engagement probabilities in real-time.
  • Multi-Task Learning ModelsA shared model architecture that predicts multiple engagement signals simultaneously to optimize content relevance across different platform surfaces.
  • Embedding-Based RetrievalCalculate similarity between users and content using numerical representations to identify relevant Tweets outside of a user's immediate social network.
  • Graph-Based Content DiscoveryA data processing architecture that traverses social and interest-based connections to identify relevant content outside of a user's immediate network.
  • Feed Composition EnginesBlend ranked Tweets with non-Tweet content like ads and recommendations to finalize the timeline display for the user.
  • Personalized Feed OrchestratorsA multi-stage content assembly layer that blends diverse media types and social signals into a unified, ranked user experience.
  • Feed Filtering HeuristicsApply heuristics and filters to the ranked feed to ensure content diversity, visibility preferences, and social quality safeguards.
  • Content Filtering HeuristicsA post-ranking processing layer that applies safety, diversity, and visibility constraints to ensure content quality before final delivery.
  • Similarity Search EnginesA vector-based retrieval mechanism that identifies relevant content by calculating geometric proximity between user and tweet representations in high-dimensional space.
  • Graph Traversal StrategiesA data-retrieval strategy that traverses social and interaction edges to discover relevant content outside of a user's immediate network.
  • ML Serving InfrastructureManage shared data services, machine learning models, and high-performance serving frameworks that power recommendation and interaction features across the platform.
  • Personalized Notification EnginesSurface personalized content recommendations via push notifications using multi-task learning models to predict user engagement probabilities and relevance.