Nemo2011/bilibili-api
Bilibili Api
bilibili-api is a Bilibili API wrapper and content scraper designed for programmatically accessing video metadata, user profiles, and content data. It functions as an anti-bot crawler framework and a WebSocket live chat client for retrieving platform information and real-time interaction data.
The project incorporates tools to bypass anti-crawling measures and rate limits through the use of proxies and TLS fingerprint spoofing. It also includes logic for mapping and converting various video and content identifiers to ensure consistent data retrieval across different endpoints.
Its capability surface covers Bilibili data extraction, live stream monitoring, and media archiving, which includes downloading subtitles and comment files. The library also provides functionality to extract text and data from articles and columns via web crawling.
Features
- Data Extraction - Provides a programmatic wrapper to retrieve Bilibili video metadata, audio info, and user profiles.
- API Wrappers - Provides a structured programmatic interface to access Bilibili video metadata, user profiles, and content data.
- WebSockets and Real-time - Maintains persistent WebSocket connections to receive real-time chat and interaction data from Bilibili live streams.
- Bilibili Content Scrapers - Implements a scraper to extract text and data from articles, columns, subtitles, and comments.
- Content Restriction Bypasses - Uses proxies and browser fingerprints to bypass bot detection and prevent IP bans.
- Video Content - Retrieves video metadata and facilitates user actions using specific Bilibili video identifiers.
- Metadata Extraction - Retrieves video metadata, user information, and article content from Bilibili via automated API requests.
- Interaction Monitoring - Connects to WebSocket servers to capture real-time chat messages and interaction data from Bilibili live streams.
- Asynchronous HTTP Clients - Provides an asynchronous HTTP client pipeline for concurrent retrieval of Bilibili metadata and user information.
- Proxy Routing - Routes network traffic through a rotating set of proxy servers to avoid IP-based rate limits.
- Anti-Bot Evasion - Ships a framework that mimics browser fingerprints and headers to evade bot detection services.
- Traffic Mitigation Bypasses - Bypasses bot detection services and rate limits using proxies and TLS fingerprinting.
- TLS Fingerprint Impersonators - Impersonates specific browser TLS fingerprints to bypass security filters and avoid bot detection.
- Live Stream Chat Interactions - Establishes real-time connections to Bilibili stream servers to receive instant chat messages.
- Real-Time Data Capture - Connects to socket servers to capture real-time comments and interaction data from Bilibili live streams.
- Web Scraping Evasion Tools - Implements proxies and TLS fingerprint spoofing to bypass rate limits and security filters during data collection.
- Bilibili Media Downloads - Fetches Bilibili subtitles and comment files for local offline storage.
- Web Article Extraction - Retrieves text and structured data from Bilibili articles and columns using a web crawler.
- Offline Media Archiving - Downloads subtitles and comment files for long-term preservation and offline access.
- WebSocket Clients - Maintains persistent WebSocket connections to retrieve real-time chat messages and interaction data from live streams.
- Web Crawling - Implements web crawling to extract text and data from Bilibili articles and columns by simulating browser behavior.
