{"id":478,"date":"2017-10-26T13:38:38","date_gmt":"2017-10-26T12:38:38","guid":{"rendered":"http:\/\/blog.magnusmanske.de\/?p=478"},"modified":"2017-10-26T13:38:38","modified_gmt":"2017-10-26T12:38:38","slug":"478","status":"publish","type":"post","link":"http:\/\/magnusmanske.de\/wordpress\/archives\/478","title":{"rendered":""},"content":{"rendered":"<p>In my last blog post &#8220;<a href=\"http:\/\/magnusmanske.de\/wordpress\/?p=471\">The Big Ones<\/a>&#8220;, I wrote about my attempts to import large, third-party datasets, and to synchronize those with Wikidata. I have since imported three datasets (BNF, VIAF, GND), and created a <a href=\"https:\/\/www.wikidata.org\/wiki\/User:Magnus_Manske\/Large_Datasets\">status page<\/a> to keep a public record of what I did, and try to do.<\/p>\n<p>I have run a few bots by now, mainly syncing identifiers back-and-forth. I have put a few security measures (aka &#8220;data paranoia&#8221;) into the code, so if there is a collision between the third-party dataset and Wikidata, no edit takes place. But these conflicts can highlight problems; Wikidata is wrong, the third-party data supplier is wrong, there is a duplicated Wikidata item, or some other, more complex issue. So it would be foolish to throw away such findings!<\/p>\n<p><a href=\"http:\/\/magnusmanske.de\/wordpress\/wp-content\/uploads\/2017\/10\/Screen-Shot-2017-10-26-at-13.37.27.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-480\" src=\"http:\/\/magnusmanske.de\/wordpress\/wp-content\/uploads\/2017\/10\/Screen-Shot-2017-10-26-at-13.37.27-300x152.png\" alt=\"\" width=\"300\" height=\"152\" srcset=\"http:\/\/magnusmanske.de\/wordpress\/wp-content\/uploads\/2017\/10\/Screen-Shot-2017-10-26-at-13.37.27-300x152.png 300w, http:\/\/magnusmanske.de\/wordpress\/wp-content\/uploads\/2017\/10\/Screen-Shot-2017-10-26-at-13.37.27-768x388.png 768w, http:\/\/magnusmanske.de\/wordpress\/wp-content\/uploads\/2017\/10\/Screen-Shot-2017-10-26-at-13.37.27-1024x518.png 1024w, http:\/\/magnusmanske.de\/wordpress\/wp-content\/uploads\/2017\/10\/Screen-Shot-2017-10-26-at-13.37.27.png 1123w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><br \/>\nBut how to use them? I had started with a bot updating a Wikidata page, but that has problems, mostly, no way of marking an issue as &#8220;resolved&#8221;, but also lots of sustained edits, overwriting of Wikidata user edits, lists too long for wikitext pages, and so on.<\/p>\n<p>So I started collecting the issue reports in a new database table, and now I have written a <a href=\"https:\/\/tools.wmflabs.org\/mix-n-match\/large_catalogs.php\"><strong>small tool<\/strong><\/a> around that. You can list and filter issues by catalog, property, issue type, status, etc. Most importantly, you can mark an issue as &#8220;done&#8221; (OAuth login required), so that it will not show up for other users again (unless they want it to). Through some light testing, I have already found and merged two duplicated Wikidata item pairs.<\/p>\n<p>There is much to do and improve in the tool, but I am about to leave for WikidataCon, so further work will have to wait a few days. Until then, enjoy!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In my last blog post &#8220;The Big Ones&#8220;, I wrote about my attempts to import large, third-party datasets, and to synchronize those with Wikidata. I have since imported three datasets (BNF, VIAF, GND), and created a status page to keep a public record of what I did, and try to do. I have run a [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9],"tags":[],"class_list":["post-478","post","type-post","status-publish","format-standard","hentry","category-wikidata"],"_links":{"self":[{"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/posts\/478","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/comments?post=478"}],"version-history":[{"count":2,"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/posts\/478\/revisions"}],"predecessor-version":[{"id":481,"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/posts\/478\/revisions\/481"}],"wp:attachment":[{"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/media?parent=478"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/categories?post=478"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/magnusmanske.de\/wordpress\/wp-json\/wp\/v2\/tags?post=478"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}