Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of readact

readact - v2.0.1 Fabrications

Minor tweaks to improve future releases and zenodo integration.

No data updates

- XQuery
Published by duncdrum over 3 years ago

readact - Fabrications

Features ReadAct v.2.0.0 Fabrications

Fabrications introduces fictional readings acts to our dataset, ie.reading acts that occur in fictional worlds. This required a serious re-work of our content model so we could include reading acts as they occur in e.g. in 三体 far future realms. Secondly, we include QID lookup and validation via our new tool ReadActor which is now integrated into everything ReadAct. All entities have been processed and compared to wikidata, and such lookups are fully automated going forward. To make data input less work intensive and error prone. Lastly, based on popular demand, we create and maintain a template repo besides ReadAct. To allow interested persons, to use both ReadActs datamodel and tooling, but with an entirely empty database.

thanks to @mira-gruenwald for 124 commits with fictional reading acts and bug fixes. thank you @whalekeykeeper for developing ReadActor.

Core Features

  • Upgrade data-model to accommodate fictional reading acts #498
  • Refactor primary entities (Agent, Work, Space)
  • Automate semantic web integration to wikidata via ReadActor
  • Init Template Repo for easier extensibility of ReadAct

Data

  • 610 new reading acts
  • 292 new agents
  • 264 new works
  • 86 new places

numerous bug fixes, typos, and updates

New Tables and Fields

  • NarrativePosition.csv to capture agent model of realist socialist fiction writing
  • wikidata_id to capture wikidata qids for agent and space entities
  • fictionality to capture the ontological status of agent, act, work, or space entities
  • Rustication is now its own table, it used to be part of Person

minor refactoring to unify schema constrains, and increase table consistency

Fixes

  • b2af636800098071242382d9b2aa0ed158d08faf ignore(data-dic): fix typo
  • 295b5f96f57d7fdf0094a6048be6cbb96e7049d3 fix(acts): replace missing PS with PS09999
  • ae63d5367691c1ad0255533a06cbb873d542fb57 add UML folder
  • 468f7ec562be29aca718b3635c323792c16b560b feat(var): simple lit additions
  • 2b9067da00c0c65b1e6135fa30f70b6b19755de6 fix(var): lit tables
  • 416b3ea5d75ea77bc0318a0c53dfba74c300f7d3 hotfix(var): dedupe ids
  • 451a7105954c012b2b3f83e21bf141618d4ec022 changed Act ids and completed AW
  • 6f031588adc1a2c555ae53b3dc09e6ff08cb6c65 feat(LO): some new tables all v2 URL needs adjusting after merge to master
  • 800f870eb317cce4c6769abb0b894d95a5e5d3b7 Person and SecSource
  • 5e67f4d03941b98d5daf61ef1c185ad843c7f4af changed narr.status/social status/ data-dict.
  • 4d73d777e04f006f943020050ac85296bfde80b9 PrimarySources and first Acts
  • 830eec0e2474051dff35ce07c90a7026c5990505 acts
  • ef7cff8ffb3c07b3ab5a2fa332980393ce9c4a31 acts and new act type: to disfigure
  • 42eaaba240bd6a434561fd6de4b7a0379dbd9b53 acts in 'The Class Teacher'
  • fd4a6c05937560c346842f4decbd1d7f2e250eb1 finished act transfer
  • 888882410fb3a4aa2a39b47840a0d249fb67bb15 added info to PS and Act-files
  • 47e6aecb23651bfb3a0cad5fffc7544bac0728a5 Update PrimarySource.csv
  • a6bcc5da2275067289f9105dc700b8e15948a651 new act types planning to read and planning to read collectively
  • f1c3238ab11079c11dea4ecc73553c7998cf7d71 Readings in song of youth (#419)
  • 105590fd61efb56d7ed5db717ddbfc896e474752 characters and act_objects
  • 00385d1d4153965c8f5293dec9c1f801519b535d acts
  • 8beab279a45032682b06087cd6bcc9bd0dc42770 test(bats): fix acts to account for institutional agency
  • 738561bcce13e34c2ecd64b052ec3525d9e7713d refactor(all): sort csv to prep for merge
  • 5d287a11e93b41942b70fc0cc0849e6f4a8056e0 protagonist, source and PS
  • 183a779081acf93eb4ca4e48ada70f001e15e788 info and acts
  • 0987dfd368b566115eef73d73447488c1e7238fd Update Act.csv
  • 6f4db9df36e47208324fd85f528cbbe3df841f3e acts/ changed date of birth/ narrative age
  • 3db1c4ad51b30fd515eac06da763a7d7d2197ff4 acts
  • 4c18abb91b0367b3def89a64bdd6f8e7d66aa084 Protagonists, Social Relations, PrimarySources
  • 491e74e0218f06e21cadb49a98feefcdf68b56f8 Acts
  • a7097ff98e816bef940e8170727f50aacc24020a Update Person.csv
  • 7fe883dd4aba89b792eea093fa6f3937ca749911 SecondarySource and protagonists
  • fe1f51dc215c0a5490d624d36612c9417a88cbe8 added Jiang Qing to Person.csv / Quotation
  • 7951347421a473efdaf9bdb5f40d23d81efba60c Acts
  • a844dee6b2f3f29a56317c48d66eb823e72fb98d Update Quotation.csv
  • bfd3dbb8fd1d9c0f6361321c09b1c97d647aeca5 Update Quotation.csv
  • 7aa8b7d677a9da1ea66180e06767e3d6bc015d6e update quotation
  • e9a1a8ef3e800760f44587813d5e951bec2fc287 person and secondary source
  • a44e627d91307a229870e554566ebe693fe8e912 close #438
  • 6f6b46f70cdcc414201ed8c286ee330fc48b082b PrimarySource and Person
  • e092929ad736097aed10633787efc06355827ed5 PS and Acts
  • 1e850360d67e672807b77a7c2891da80e1c02347 SecSources and authors
  • 2109aac0c3074659ce65284e891de0c8b47b881e English translations
  • 56fa85b42399d79637d51c4ad2238b85c37ae8b6 SecSources and Persons
  • 79bae018d41d89649c5f9af1b46147ea9367adfd SecSources and Person
  • 0971a1396c77ddbb10b99fd3d993b7f85f451802 Secondary Sources
  • 42732db45cc5535f6d3e7d91f3dc0b26b9403f86 SecondarySource and Person
  • d18b66568304f9c241b15c90e87a64b3bd9f65aa Updated Person.csv
  • 45d5556224d41a698d48583735c1de91567bc52b Person.csv
  • 41cc4462191e8f8048b8ac714ce419c32c5f4a81 Update Person.csv
  • b6df758d0b1620933f288044f92eade76be3774d Acts and related entries
  • aab8c7071fa51a2004999bd8516a7742935aae24 Acts - SS00665, SS00664 and SS00660
  • 408dfa406983198b7f0b896b17c2e55b1cfdbaca G is for Goddess
  • 7cfe0fd3af23ab941f796571ccfce5d3f33b91df Star Camp (1)
  • 2b16378edf2b9aa2ff2cdbdee59e2739e1fca1d5 Star Camp (2)
  • 36e6b374e84d51e76957368dc6fe90570b2d8ef6 Reading Time - Star Camp
  • 1e67db8c7b9388ee87a30bb4bb0a2990323d9845 Chi Shuchang : Elephants...
  • b781fc5fa73e17262530cdcb3cf9186703f28de5 Update Person.csv
  • 47b192dd1a7f9366dadff7d13f02f0b54480dc83 some adjustments
  • b8c1f9372c307d836b02710bda2a2432b41a75f1 Reading time and Little Smarty
  • 0b6e2f42f2311710523b350fc908836669f10c53 Update Person.csv
  • 0d12b5d723ffc84f900794825af6d5b1d30a9834 Little Smarty - original version
  • 41a70f0426d71795a2de74b5afa728817df46fd8 Coming of the Light
  • dfc3a6666b7d42f3ecb71949b425f79817d840dd Broken Stars
  • 46fab57502ac34deac564d6a1341e0665ae1bdcf under a dangling sky
  • 140d37c003e61ab1ba5f18a21a8067de3e5e2755 Restaurant at the end of the universe
  • 926b121a2872e1722c6465c3ac49382c81c4462d restaurant at the end of the universe
  • 41d06373d12c3f7f3b8d4e181096a10fddb5a316 Restaurant at the end; a hundred ghosts parade; Invisible Planets...
  • 144477140f9dbd9055b362e25799f12d10c7713c reincarnated giant
  • b371267af7f6b163e5cfd5de23e92cd648651279 The Reincarnated Giant
  • 8783d78041d50ab488d57b2f9a069e9694a89d38 Update PrimarySource.csv
  • d858eecddf55a76b68ed3242ea7cdc4e22169ef6 Fish in Lijiang; The Village Schoolteacher; Boundless Love
  • f0b274702eac1e86a620d3ac83dfcf603d89e9ff Liebe im Unendlichen; Zersetzung; Rätsel Beta; Dr Salomos Irrtum
  • 979f728c65db54dce8f03346d70b886a998e2d8e Der Traum vom Sanften Land
  • ac59c427cbaf054eebbe1fa390c005206568729d Traum vom Sanften Land
  • 46e9e70c8344af8f8f772d0d37f488ed93f8180b Traum vom Sanften Land
  • 7736c30f865d44a3bd0adc122ffb11519dec976c Mysterious Waves
  • a988913fc04bf065a07bf81bb34e171f28a63ad0 Seeufer, Read as you..., Mirror image of the earth
  • 93dde1b7379f680c288c56db9e36da8566668aba Death Rays and Reincarnated Bricks
  • ed23d06d67953656e2b82572899489000fa243dc Poetry Cloud and death of a robot
  • a22062f5c0f200f5e810fad8faf07e9c7e55fde0 Balin and Demon enslaving flask
  • c64830a2ccafea753a3660b633d5a501ffd7097f Rain Forest and Year of the Rat
  • 472f039d8dc82f509b4dbcb46b933316ec1cd31b History of Future Illnesses
  • b708335fe9f4a0df2ea27e6f5df36d89530b752f History of Future Illnesses and Radio Waves that never die
  • 406349eccdfdb7ad83dd5b3f87e7ebbbd0750bb4 minor corrections
  • 58de8ded6e4f1d1d5e8cc10710906f8ef950d61f Ignore .idea folder
  • d5fe2c5654e01375afd0dc1eb08eac83e2b03941 corrections
  • a7066ef6e9cb96f53642149f7b6fc8b4d7cb5dc1 Revert "Merge branch 'SF-3' of https://github.com/readchina/ReadAct into SF-3"
  • fb00f077c542cd6bd7eec3d76d005e2040227810 Revert "Revert "Merge branch 'SF-3' of https://github.com/readchina/ReadAct into SF-3""
  • a5cf067fcb52d043147a4d667a48b8c70be28d50 SF acts ods first attempt
  • fd47bfa0283a273b661a6077bb1f9e763fbb5b1d Update .gitignore
  • 3bbe3578627c5eb80487a3c371cca189588b50d1 corrections
  • 86bd1e17e2adc199856a345d04e468c8c3499fa7 continuation of the chart
  • b86702029c7a5711d7421d76ffe33cf09de047f3 Update PrimarySource.csv
  • 7a0c4a0564dad9bb9dfb05c922f72cef1000f551 ignore(bats): adjust expected ouput for 2nd Institutional agent
  • fdabe82ba518c8b4ebd267f1af880715ca6ee1c5 secondarySource and Persons
  • 3d12bc24f3e7a7979e99781176133fae000ffadf protagonists, PS and acts
  • eb5c754a871a0283a5bb24d4adb358a3635caadd acts and new act types
  • 7d5d6950bfaa7a6246e11002ed677bbab3bedea0 Update Person.csv
  • c5abd6555dc6e60ae074a73c2412e4f96c287816 Update Person.csv
  • 2bef1698f9a665a6b7f9da74a859926cf8b2e075 fix(person): validation errors
  • 39bef8ea286ac131255c5b592389d7b43cff6469 add linked csv files
  • ebd267bb8de1a17ff9ff96e6046eacc9069dd9c8 Update ActType
  • 82bd79e5abc632d35d1c1814cb9981db902b5d47 graph_1
  • 7add15498e10fa33d4ea139215e978fac8b30328 cosmetics
  • 918feda01ecec8e574c6593717108a764f8d2e15 ignore(csv): sort and cleanup
  • d54a7dfd13d16568d949e5dbae5eaa069d64ed66 fix(act): rename discussion

What's Changed

  • Cleanup 1.1.0 by @duncdrum in https://github.com/readchina/ReadAct/pull/434
  • Cleaning 2 removing old files and automating the generation of new ones by @duncdrum in https://github.com/readchina/ReadAct/pull/437
  • hotfix(rActs): fix json generation via baseX by @duncdrum in https://github.com/readchina/ReadAct/pull/440
  • Act site of reading by @mira-gruenwald in https://github.com/readchina/ReadAct/pull/443
  • Site info act table by @mira-gruenwald in https://github.com/readchina/ReadAct/pull/445
  • Site info act.csv by @mira-gruenwald in https://github.com/readchina/ReadAct/pull/450
  • Add site of reading information to Tei output by @duncdrum in https://github.com/readchina/ReadAct/pull/451
  • Issue 229 by @mira-gruenwald in https://github.com/readchina/ReadAct/pull/454
  • Update Act.csv by @mira-gruenwald in https://github.com/readchina/ReadAct/pull/455
  • ignore(ci): bump deps by @duncdrum in https://github.com/readchina/ReadAct/pull/448
  • [hotfix] deploy step from CI by @duncdrum in https://github.com/readchina/ReadAct/pull/478
  • fix(works): minor corrections by @duncdrum in https://github.com/readchina/ReadAct/pull/480
  • perf(ci): refactor validation on ci by @duncdrum in https://github.com/readchina/ReadAct/pull/481
  • Titles not in 'zh' and not in 'zhLatnpinyin' will be returned by @whalekeykeeper in https://github.com/readchina/ReadAct/pull/483
  • deps(tei): update to latest release 4.3.0 by @duncdrum in https://github.com/readchina/ReadAct/pull/485

Full Changelog: https://github.com/readchina/ReadAct/compare/1.1.0-beta...2.0.0

- XQuery
Published by duncdrum over 3 years ago

readact - On the Road

Refactoring

  • fixes multiple issues and makes physical data model easier to implement.
  • changes to the folder layout.
  • rename repo and add links to new website
  • introduce datapackage.json as meta-data storage location (including views)
  • migrate table schemas from their own repo into ReadAct repo

Contents

  • new base tables Work, Space, Agent. Person, Institution, Location, Place, AW, PrimarySources, SecondarySources are now sub-tables.
  • change 90% of ids (it had to happen)
  • Quotations or Genres are no longer valid Act.act_object see #355
  • we now use the comment field and the structural entries for unknown works across the whole Db fixed a number of data input errors
  • remove NULL with empty cells consistently and in line with schema updates
  • consistently use structural entries instead of unknown

Test and Schema

  • More and more accurate tests,
  • switching to python validator to avoid regex errors with ruby implementation
  • let travis generate view tables after each commit for easier display of visualizations

- XQuery
Published by duncdrum over 5 years ago

readact - ReadingData beta

This catches the old data warts and all. Not production ready.

- XQuery
Published by duncdrum almost 6 years ago