NewsAPI.org
Business software
Sync NewsAPI.org article, source, and headline data into your warehouse. Ingest builds this connector the first time a customer asks for it, then keeps the tables current in a data warehouse you own, on the schedule you choose.
The NewsAPI.org connector syncs your news article data into analytics-ready tables in your data warehouse. Pull articles, sources, and headlines from the NewsAPI.org API, with Ingest handling auth, pagination, and retries so the tables stay current.
What you would get
Each of these arrives as its own table, kept current on the schedule you choose:
- Articles
- Sources
- Headlines
How it gets built
- Choose NewsAPI.org when you set up a pipeline, with the warehouse it goes to and a schedule.
- Ingest reads NewsAPI.org's documentation, and you choose the tables you want.
- Ingest builds the connector and tests it against NewsAPI.org itself.
- A person at Ingest reviews and publishes it, and your pipeline starts on its own.
What you will need
API key (apiKey query param, X-Api-Key, or Authorization header). Free key issued instantly on signup; the free tier is for development use only, per their terms.
You enter it once, in a form in Ingest, and it is kept in a secret store set aside for your organization.
Questions
- Does Ingest have a NewsAPI.org connector?
- Not as a finished connector yet. Ingest builds it from NewsAPI.org's own documentation the first time a customer asks, tests it against the real service, and lists it once it passes.
- Which warehouses can NewsAPI.org data go to?
- Amazon S3, Google Cloud Storage, Azure Blob Storage, Apache Iceberg, Ingest Managed Lakehouse, MotherDuck, Postgres, Amazon Athena, Databricks, Redshift, BigQuery, ClickHouse, MySQL / generic SQL and Snowflake, in an account you own.
- Do I need to write code?
- No. Ingest builds, runs and maintains the connector. Someone with access to your warehouse connects it once, following a short guide.
NewsAPI.org API documentation: https://newsapi.org/docs/authentication
Where this would land, and what else connects
Setting up the destination is its own short guide, one per warehouse or lake: Amazon S3, Google Cloud Storage, Azure Blob Storage, Apache Iceberg, Ingest Managed Lakehouse, MotherDuck, Postgres, Amazon Athena, Databricks, Redshift, BigQuery, ClickHouse, MySQL / generic SQL, Snowflake.
Other sources Ingest connects for SaaS teams: Asana, Jira, Airtable, Clockify, Facebook Ads, Frankfurter.