🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
-
Updated
Jul 12, 2026 - Python
Individual facts, statistics, or items of information, often numeric. In a technical sense, data are a set of values of qualitative or quantitative variables about one or more persons or objects.
(https://en.wikipedia.org/w/index.php?title=Data&oldid=1093674723, released under CC BY-SA 3.0)
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
The 30 Days of Python programming challenge is a step-by-step guide to learn the Python programming language in 30 days. This challenge may take more than 100 days. Follow your own pace. These videos may help too: https://www.youtube.com/channel/UC7PNRuno1rzYPb1xLa4yktw
LlamaIndex is the leading document agent and OCR platform
Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库
📙 中华新华字典数据库。包括歇后语,成语,词语,汉字。
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Easy Data Preparation with latest LLMs-based Operators and Pipelines.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
A next-generation curated knowledge sharing platform for data scientists and other technical professions.
Edit Banana: A framework for converting statistical formats into editable.
Superduper: End-to-end framework for building custom AI applications and agents.
CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers catalog.data.gov, open.canada.ca/data, data.humdata.org among many other sites.
Mimesis is a fast Python library for generating fake data in multiple languages.
TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师,自动分析大量数据,一键生成专业分析报告!