Skip to content

Category Archives: Wikidata

Using AI to add to Wikidata

AI and the WikiVerse have a complicated an developing relationship. Here, I investigate possible uses of AI to assist with imports of unstructured data from Mix’n’Match into Wikidata. Approach At the time of writing, Mix’n’match contains ~162M entries. Many of them have a more-or-less helpful short description, usually taken from the respective third-party source. I […]

Mix’n’match stats

Just a fun little statistic for Mix’n’match. This is how many entries were matched in MnM, per year. Note: This includes Wikidata imports (eg a property exists, matches from Wikidata are imported when the catalog is created). 2013 1,905 2014 86,562 2015 572,467 2016 1,667,843 2017 2,570,586 2018 5,166,435 2019 4,002,785 2020 7,203,921 2021 4,930,444 […]

Artworks: At least, let’s use what we already have

Wikimedia Commons has a lot of artworks, but it is difficult to find and query them; they sit there if you know exactly what you want, but otherwise they collect digital dust. Wikidata has many artworks that can be queried, but is missing many that are already on Commons. If there were only some way […]

Merge and diff

Originally, I wanted to blog about adding new properties (taxon data speficially, NCBI, GBIF, and iINaturalist) to my AC2WD tool (originally described here). If you have the user script installed on Wikidata, AC2WD will automatically show up on relevant taxon items. But then I realized that the underlying tech might be useful to others, if […]

A quick comparison

Over the years, Mix’n’match has helped to connect many (millions?) of third-party entries to Wikidata. Some entries can be identified and matched in a fully automated fashion (eg people with birth and death dates), but the majority of entries require human oversight. For some entries that works nicely, but others are hard to disambiguate from […]

Mix’n’match background sync

My Mix’n’match tool helps matching third-party catalogs to Wikidata items. Now, things happen on Mix’n’match and Wikidata in parallel, amongst them: Wikidata items are deleted Wikidata items are merged, leving one to redirect to the other External IDs are added to Wikidata This leads to the states of Mix’n’match and Wikidata diverging over time. I […]

Cram as cram can

So I am trying to learn (modern) Greek, for reasons. I have books, and online classes, and the usual apps. But what I was missing was a simple way to rehearse common words. My thoughts went to Wikidata items, and then to lexemes. Lexemes are something I have not worked with a lot, so this […]

Musings on the backend

So the Wikidata query service (WDQS), currently powered by Blazegraph, does not perform well. Even simple queries time out, it lags behind the live site, and individual instances can (and do) silently go out of sync. The WMF is searching for a replacement. One of the proposed alternatives to blazegraph is Virtuoso. It models the […]

GULP

Lists. The plague of managing things. But also surprisingly useful for many tasks, including Wikimedia-related issues. Mix’n’match is a list of third-party entries. PetScan generates lists from Wikipedia and Wikidata. And Listeria generates lists on-wiki. But there is a need for generic, Wikimedia-related, user-curated lists. In the past, I have tried to quell that demand […]

Turn the AC on

A large part of Wikidata is the collection of external identifiers for items. For some item types, such as items about people (Q5), some of this is what is known as Authority Control (AC) data, for example, VIAF (P214). One thing that distinguishes AC data from other external IDs is that AC data sources are […]