Skip to main content

Wikipedia Pageviews

Availability
Available CoreAvailable StandardAvailable PlusAvailable ProAvailable Enterprise FlexAvailable PyAirbyte
Connector type (beta)
Available Data replicationNot available Agent(learn more)
Support Level
Marketplace
Connector Version
0.2.24 (last updated 3 days ago)
Sync Success Rate
Low
Usage Rate
Low
Data workers used
0.2 per sync (Learn more)
Definition ID
87c58f70-6f7a-4f70-aba5-bab1a458f5ba

This page contains the setup guide and reference information for the Wikipedia Pageviews source connector.

Prerequisites​

None

Setup guide​

Step 1: Set up the Courier connector in Airbyte​

For Airbyte Cloud:​

  1. Log into your Airbyte Cloud account.
  2. In the left navigation bar, click Sources. In the top-right corner, click +new source.
  3. On the Set up the source page, enter the name for the Courier connector and select Wikipedia Pageviews from the Source type dropdown.
  4. Enter your parameters.
  5. Click Set up source.

For Airbyte OSS:​

  1. Navigate to the Airbyte Open Source dashboard.
  2. Set the name for your source.
  3. Enter your parameters.
  4. Click Set up source.

Supported sync modes​

The Wikipedia Pageviews source connector supports the following sync modes:

FeatureSupported?
Full Refresh SyncYes
Incremental SyncYes
Replicate Incremental DeletesNo
SSL connectionYes
NamespacesNo

Supported Streams​

  • per-article (incremental, one record per day for the configured article)
  • top (full refresh, the top 1000 articles of the project on the start date)

Configuration notes​

  • start and end are dates in YYYYMMDD format. Pageviews data is available from 2015-07-01.
  • end is optional. Leave it empty to keep syncing up to the latest day published by Wikimedia. Data for a given day is published a few hours after that UTC day ends, so the connector never requests dates later than two days ago; an end date in the future is capped accordingly.
  • article must be URI-encoded (spaces replaced with underscores).
  • Wikimedia rate-limits unauthenticated clients aggressively (HTTP 429 with a Retry-After header). The connector fetches per-article data in monthly windows and waits for the time Wikimedia asks for before retrying, so large date ranges still sync but may take a few minutes.

Performance considerations​

100 req/s per endpoint.

IP allow list​

If you use Airbyte Cloud and your organization restricts access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.

Reference​

Config fields reference

Field
Type
Property name
string
access
string
agent
string
article
string
country
string
project
string
start
string
end

Changelog​

Expand to review
VersionDatePull RequestSubject
0.2.242026-10-1379077Update dependencies
0.2.232026-10-0788231Fix syncs failing with HTTP 404 when end is today or in the future (cap the date range to the latest published day, make end optional, accept YYYYMMDDHH inputs, clear error when Wikimedia has no data); request per-article data in monthly windows instead of one request per day and honor Retry-After on HTTP 429
0.2.222025-05-2460778Update dependencies
0.2.212025-05-1059940Update dependencies
0.2.202025-05-0458919Update dependencies
0.2.192025-04-1958545Update dependencies
0.2.182025-04-1358040Update dependencies
0.2.172025-04-0557399Update dependencies
0.2.162025-03-2956888Update dependencies
0.2.152025-03-2256296Update dependencies
0.2.142025-03-0855618Update dependencies
0.2.132025-03-0155129Update dependencies
0.2.122025-02-2254472Update dependencies
0.2.112025-02-1554093Update dependencies
0.2.102025-02-0853587Update dependencies
0.2.92025-02-0153103Update dependencies
0.2.82025-01-2552418Update dependencies
0.2.72025-01-1851968Update dependencies
0.2.62025-01-1151393Update dependencies
0.2.52024-12-2850807Update dependencies
0.2.42024-12-2150345Update dependencies
0.2.32024-12-1449734Update dependencies
0.2.22024-12-1247763Update dependencies
0.2.12024-10-2847618Update dependencies
0.2.02024-08-2044460Refactor connector to manifest-only format
0.1.102024-08-1744202Update dependencies
0.1.92024-08-1243771Update dependencies
0.1.82024-08-1043543Update dependencies
0.1.72024-08-0343184Update dependencies
0.1.62024-07-2742706Update dependencies
0.1.52024-07-2042242Update dependencies
0.1.42024-07-1341686Update dependencies
0.1.32024-07-1041560Update dependencies
0.1.22024-07-0941081Update dependencies
0.1.12024-05-3138724Make connector compatible with builder
0.1.02022-10-31#18343Initial commit
Was this page helpful?