Compare commits

..
Author SHA1 Message Date
salt d39962491f fix some warnings (mostly unnecessary mut) 2023-12-07 18:36:51 -08:00
Brandon Thomas eedbc346fe Merge pull request #194 from storytold/brandon-tts-as-media-file
Save TTS results as media files
2023-12-06 23:33:51 -05:00
Brandon Thomas 7976f68fd0 Save TTS results as media files 2023-12-06 23:31:47 -05:00
Brandon Thomas 8a6678c7f5 move workspace-hack under crates/ 2023-12-06 02:12:57 -05:00
Brandon Thomas d9b1c8c36b Merge pull request #192 from storytold/brandon-upgrade-chrono-vendored-limitation
upgrade chrono with vendored limitation
2023-12-05 21:54:36 -05:00
Brandon Thomas fc122cb996 upgrade chrono with vendored limitation 2023-12-05 21:54:06 -05:00
Brandon Thomas e0e85fed5f Merge pull request #191 from storytold/brandon-vendor-limitation
vendor `limitation` crate
2023-12-05 20:58:27 -05:00
Brandon Thomas 092745166e vendor limitation crate
The limitation crate is four years old, stuck at 0.1.1. It looks unlikey
to be updated by the maintainer.

Upgrades to chrono and other libraries have broken limitation, so we're
likely now on the hook for maintaining this.
2023-12-05 20:56:22 -05:00
Brandon Thomas ea859bfc1e Merge pull request #190 from storytold/brandon-revert-chrono-upgrade
Revert "Bump chrono from 0.4.22 to 0.4.31"
2023-12-05 20:40:37 -05:00
Brandon Thomas 92e0b1e9f4 Revert "Bump chrono from 0.4.22 to 0.4.31"
This reverts commit 4856ac28aa.
2023-12-05 20:40:09 -05:00
ArEnSc d52d3f993a Merge pull request #189 from storytold/feature/api-spec
Feature/api spec
2023-12-05 20:27:57 -05:00
Michael Chung 0033af73ce Feedback addressed! 2023-12-05 20:26:07 -05:00
Brandon Thomas 514f80b884 Merge pull request #184 from storytold/dependabot/cargo/rustix-0.38.26
Bump rustix from 0.38.25 to 0.38.26
2023-12-05 19:22:24 -05:00
Brandon Thomas 74c548c02f Merge pull request #182 from storytold/dependabot/cargo/chrono-0.4.31
Bump chrono from 0.4.22 to 0.4.31
2023-12-05 19:21:53 -05:00
Brandon Thomas 5fe09a182f Merge pull request #185 from storytold/dependabot/cargo/lettre-0.11.2
Bump lettre from 0.11.1 to 0.11.2
2023-12-05 19:21:40 -05:00
dependabot[bot] 4856ac28aa Bump chrono from 0.4.22 to 0.4.31
Bumps [chrono](https://github.com/chronotope/chrono) from 0.4.22 to 0.4.31.
- [Release notes](https://github.com/chronotope/chrono/releases)
- [Changelog](https://github.com/chronotope/chrono/blob/main/CHANGELOG.md)
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.22...v0.4.31)

---
updated-dependencies:
- dependency-name: chrono
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-12-06 00:19:36 +00:00
Brandon Thomas 404853e129 cleanup misleading old comment 2023-12-05 19:16:55 -05:00
Michael Chung b5fcc3cdfa Added documentation about the documentation 2023-12-05 19:14:02 -05:00
Brandon Thomas 300ac56ab7 Merge pull request #188 from storytold/brandon-media-files-global-list-fixed
global list of media files
2023-12-05 19:11:20 -05:00
Brandon Thomas e32f8094e5 global list of media files 2023-12-05 19:09:42 -05:00
Michael Chung e986a44e9d documentation system open api spec. 2023-12-05 19:00:44 -05:00
Brandon Thomas 642e17a77d Merge pull request #187 from storytold/brandon-fix-sqlx-query-builder
Fix QueryBuilder with respect to column names and type juggling
2023-12-05 18:31:13 -05:00
Brandon Thomas 36f3003576 Fix QueryBuilder with respect to column names and type juggling 2023-12-05 18:30:26 -05:00
Brandon Thomas b9f604dd18 reusable pagination types 2023-12-04 23:11:41 -05:00
Brandon Thomas e6f5ecb980 Merge pull request #186 from storytold/brandon-list-media-files-for-user
list media files for user
2023-12-04 22:02:53 -05:00
Brandon Thomas 2e3ff8a730 list media files for user 2023-12-04 21:59:39 -05:00
dependabot[bot] ac13be2900 Bump lettre from 0.11.1 to 0.11.2
Bumps [lettre](https://github.com/lettre/lettre) from 0.11.1 to 0.11.2.
- [Release notes](https://github.com/lettre/lettre/releases)
- [Changelog](https://github.com/lettre/lettre/blob/master/CHANGELOG.md)
- [Commits](https://github.com/lettre/lettre/compare/v0.11.1...v0.11.2)

---
updated-dependencies:
- dependency-name: lettre
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-12-04 22:30:26 +00:00
dependabot[bot] b55435d992 Bump rustix from 0.38.25 to 0.38.26
Bumps [rustix](https://github.com/bytecodealliance/rustix) from 0.38.25 to 0.38.26.
- [Release notes](https://github.com/bytecodealliance/rustix/releases)
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.38.25...v0.38.26)

---
updated-dependencies:
- dependency-name: rustix
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-12-04 22:30:06 +00:00
Brandon Thomas 28770ef736 fix query issue 2023-12-04 05:00:46 -05:00
Brandon Thomas 894084fba6 Merge pull request #181 from storytold/brandon-queue-controls
Kill inference jobs (mod endpoint)
2023-12-04 03:54:05 -05:00
Brandon Thomas 4bf1a25fbb Kill inference jobs (mod endpoint) 2023-12-04 03:46:29 -05:00
Brandon Thomas b0a9342194 updated queue stats 2023-12-01 07:09:23 -05:00
Brandon Thomas 3cc1ea6935 capture stderr for svc and rvc 2023-12-01 01:36:33 -05:00
Brandon Thomas b74cf7853d fix web break 2023-11-30 22:46:35 -05:00
Brandon Thomas 3cdce86162 warn on slow batch queries 2023-11-30 17:25:23 -05:00
Brandon Thomas b0a87e83a0 log batch index 2023-11-30 17:19:23 -05:00
Brandon Thomas 979c234ed2 cleanup logging 2023-11-30 16:27:25 -05:00
Brandon Thomas 4837106d37 distinguish logs 2023-11-30 16:10:01 -05:00
Brandon Thomas cfd92e814d Merge pull request #166 from storytold/dependabot/cargo/env_logger-0.10.1
Bump env_logger from 0.7.1 to 0.10.1
2023-11-30 16:02:23 -05:00
Brandon Thomas 6d27214a14 codegen 2023-11-30 15:50:05 -05:00
Brandon Thomas b628fb0a11 premium TTS duration 2023-11-30 15:21:07 -05:00
dependabot[bot] 456b9e1ce6 Bump env_logger from 0.7.1 to 0.10.1
Bumps [env_logger](https://github.com/rust-cli/env_logger) from 0.7.1 to 0.10.1.
- [Release notes](https://github.com/rust-cli/env_logger/releases)
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rust-cli/env_logger/compare/v0.7.1...v0.10.1)

---
updated-dependencies:
- dependency-name: env_logger
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-30 09:35:18 +00:00
Brandon Thomas 6f7b6da595 Merge pull request #167 from storytold/dependabot/cargo/rand-0.8.5
Bump rand from 0.7.3 to 0.8.5
2023-11-30 04:33:54 -05:00
Brandon Thomas 18ad28135f safe delete 2023-11-30 02:36:33 -05:00
Brandon Thomas ff4a3115d2 clear up more directories when file system is full 2023-11-30 02:34:33 -05:00
dependabot[bot] ccae943037 Bump rand from 0.7.3 to 0.8.5
Bumps [rand](https://github.com/rust-random/rand) from 0.7.3 to 0.8.5.
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-random/rand/compare/0.7.3...0.8.5)

---
updated-dependencies:
- dependency-name: rand
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-30 07:32:36 +00:00
Brandon Thomas 12ef105ced fix errors 2023-11-30 02:27:08 -05:00
Brandon Thomas b27070e23e get rid of more of container_common 2023-11-30 02:25:16 -05:00
Brandon Thomas 8e45a4ea45 delete mod 2023-11-30 02:05:15 -05:00
Brandon Thomas a669ac7f03 move remaining container_common::files -> filesys crate 2023-11-30 02:04:41 -05:00
Brandon Thomas b5ed9acdd4 move check_directory_exists to filesys crate 2023-11-30 01:56:55 -05:00
Brandon Thomas ff2aaa9f3d move check_file_exists to filesys crate 2023-11-30 01:53:42 -05:00
Brandon Thomas f93421eadc keep IoError around; better casting 2023-11-30 01:35:48 -05:00
Brandon Thomas b82ffcce86 much more StorageFull error ! 2023-11-30 01:26:03 -05:00
Brandon Thomas e2c5839d01 surface storage full errors 2023-11-30 01:05:26 -05:00
Brandon Thomas 896e8591ba cleanup 2023-11-29 23:10:15 -05:00
Brandon Thomas 19dcfdc629 cleanup 2023-11-29 22:51:12 -05:00
Brandon Thomas cec7bce450 try copy instead 2023-11-29 22:49:00 -05:00
Brandon Thomas 6cc3062da8 don't fail if file is gone (not sure why this happens) 2023-11-29 22:01:53 -05:00
Brandon Thomas efdd03bbbd logging 2023-11-29 21:50:30 -05:00
Brandon Thomas c207356ac5 cleanup retry 2023-11-29 21:44:20 -05:00
Brandon Thomas 3243cc51b7 try to delete and re-copy 2023-11-29 21:36:47 -05:00
Brandon Thomas ee4af2976f flag to permit cold filesystem cache 2023-11-29 21:26:03 -05:00
Brandon Thomas 4fb2a38c68 report temp file size 2023-11-29 21:10:01 -05:00
Brandon Thomas a549ceb609 check vocoder and synthesizer sizes 2023-11-29 20:53:00 -05:00
Brandon Thomas 003f0cdeea struct args for downloader (safer) 2023-11-29 20:46:33 -05:00
Brandon Thomas 9e0772141a download file size check and logging 2023-11-29 20:25:37 -05:00
Brandon Thomas 542b79dd90 log http errors 2023-11-29 19:49:52 -05:00
Brandon Thomas 363f8cbc96 debug log statements, FileCacheDir (not yet used) 2023-11-29 19:28:32 -05:00
Brandon Thomas f2e75f8637 rename files across fs devices 2023-11-29 18:46:00 -05:00
Brandon Thomas f48cbb7978 fix 2023-11-29 18:16:45 -05:00
Brandon Thomas edd5cd6156 Merge pull request #179 from storytold/brandon-fix-job-pathing
Brandon fix job pathing
2023-11-29 17:49:39 -05:00
Brandon Thomas 37c016cecb "semi persistent dir" needs cleanup, this is confusing 2023-11-29 17:48:29 -05:00
Brandon Thomas 1a3e111dd6 Fix job pathing for outage and to make easier to manage 2023-11-29 17:30:03 -05:00
Brandon Thomas 0c456d957c fix build errors 2023-11-29 15:46:43 -05:00
Brandon Thomas 85ecce7b38 comments 2023-11-29 03:07:07 -05:00
Brandon Thomas 2f1d682438 Merge pull request #176 from storytold/nov-29-mithoo
fail model deleted inference jobs
2023-11-29 02:44:38 -05:00
Brandon Thomas c6fbfaa6ba fix test failures and nits 2023-11-29 02:43:31 -05:00
Brandon Thomas 038401bff4 Merge pull request #177 from storytold/brandon-revert-sha2-bump
Revert "Bump sha2 from 0.9.9 to 0.10.8"
2023-11-29 02:29:16 -05:00
Brandon Thomas e1c7231d96 Revert "Bump sha2 from 0.9.9 to 0.10.8"
This reverts commit 951afc2e5d.
2023-11-29 02:28:51 -05:00
kasisnu 1e11fdb35d fail model deleted inference jobs 2023-11-29 12:43:49 +05:30
Brandon Thomas 74c477b045 Merge pull request #169 from storytold/dependabot/cargo/sha2-0.10.8
Bump sha2 from 0.9.9 to 0.10.8
2023-11-28 21:37:50 -05:00
Brandon Thomas 042fa1574d Merge pull request #168 from storytold/dependabot/cargo/time-0.3.30
Bump time from 0.2.27 to 0.3.30
2023-11-28 21:37:26 -05:00
Brandon Thomas 4387e6326f LFU cache in TT2 inference-job 2023-11-28 17:47:46 -05:00
Brandon Thomas 3ad2b744b7 test comment out Dockerfile /etc/ssl copy 2023-11-28 15:42:24 -05:00
Brandon Thomas 8bf85b637b notes on dependencies 2023-11-28 15:40:26 -05:00
Brandon Thomas 50c3b5ed65 codegen db 2023-11-28 15:23:43 -05:00
Brandon Thomas df15395bf7 fix build error 2023-11-28 15:08:39 -05:00
Brandon Thomas 5666d58da0 fix SSL problem? 2023-11-28 14:54:53 -05:00
dependabot[bot] 0a85e9c581 Bump time from 0.2.27 to 0.3.30
Bumps [time](https://github.com/time-rs/time) from 0.2.27 to 0.3.30.
- [Release notes](https://github.com/time-rs/time/releases)
- [Changelog](https://github.com/time-rs/time/blob/main/CHANGELOG.md)
- [Commits](https://github.com/time-rs/time/compare/v0.2.27...v0.3.30)

---
updated-dependencies:
- dependency-name: time
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-28 16:45:21 +00:00
ArEnSc bd0ce25d94 Merge pull request #151 from storytold/feature/weights_queries
Feature/weights queries
2023-11-28 11:43:00 -05:00
ArEnSc 9f2335bfba Merge branch 'master' into feature/weights_queries 2023-11-28 11:30:22 -05:00
Brandon Thomas 63eca62f1d ssl to GCS broken in production, maybe this fixes? 2023-11-28 11:01:36 -05:00
Brandon Thomas 2808d20a35 fix wrong cleanup 2023-11-28 08:43:00 -05:00
Brandon Thomas 2d67947479 comment 2023-11-28 08:39:54 -05:00
Brandon Thomas 9722a34c8b extra care to delete temp directories 2023-11-28 08:37:08 -05:00
Brandon Thomas 643dffc08c scoped TempDir 2023-11-28 08:23:43 -05:00
Brandon Thomas 1433eca29a queue stats for inference-job's tacotron2 2023-11-28 07:27:26 -05:00
Brandon Thomas 8176f0d6bd fix lints 2023-11-28 06:26:17 -05:00
Brandon Thomas 2cfcbf8a75 db codegen + fix build errors 2023-11-28 06:19:37 -05:00
Brandon Thomas fb9a9b75bf Merge pull request #171 from storytold/brandon-tts-on-inference-job
tts-inference-job --> inference-job
2023-11-28 05:51:58 -05:00
Brandon Thomas 2a1675d865 formatting 2023-11-28 05:42:50 -05:00
Brandon Thomas f672df7386 add TT2 HTTP sidecar health checking (hacky) 2023-11-28 05:11:43 -05:00
Brandon Thomas 59fc891ce4 filter out certain model types (so we don't leak to competitors) 2023-11-28 02:59:01 -05:00
Brandon Thomas 739f234ac3 emulate TTS Results in media file pages 2023-11-28 02:42:55 -05:00
Michael Chung 8303066c38 Added serial test to run the database tests in serial, prevent failing when running the suite. 2023-11-28 00:16:44 -05:00
Michael Chung 5feb500b5e unit test for paging 2023-11-27 23:16:43 -05:00
Brandon Thomas 626157b615 emulate TTS inference job status checking for generic jobs 2023-11-27 22:19:27 -05:00
Brandon Thomas 7f3ccdc53d cleanup dependency checking 2023-11-27 21:22:27 -05:00
Brandon Thomas cc1d7f6de1 theoretically TTS HTTP works with inference-job 2023-11-27 20:55:13 -05:00
Brandon Thomas 3d4a870190 streamline inference-job tt2 2023-11-27 20:55:13 -05:00
Brandon Thomas 824d113dfc port some dependencies of tts-inference-job to inference-job 2023-11-27 20:55:13 -05:00
Brandon Thomas eaadc8242d remove (unused) tts-inference-job shell out code 2023-11-27 20:55:13 -05:00
Brandon Thomas bf5dddf6a9 Merge pull request #170 from storytold/brandon-seed-tt2-models
seed tool: TT2 models (with idempotency + early exit)
2023-11-27 20:50:31 -05:00
Brandon Thomas 22051f2dba make idempotent 2023-11-27 20:42:37 -05:00
Brandon Thomas d777346520 Update seed tool to seed TT2 models 2023-11-27 18:31:42 -05:00
dependabot[bot] 951afc2e5d Bump sha2 from 0.9.9 to 0.10.8
Bumps [sha2](https://github.com/RustCrypto/hashes) from 0.9.9 to 0.10.8.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.9...sha2-v0.10.8)

---
updated-dependencies:
- dependency-name: sha2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-27 22:32:08 +00:00
Michael Chung d990fd4bfa Merge branch 'feature/weights_queries' of https://github.com/storytold/storyteller-rust into feature/weights_queries 2023-11-27 12:12:02 -05:00
Michael Chung 6f5edf0c96 fixed issues with weights queries and the tests, tests slightly flaky need to have it delete the rows, and ensure it doesn't run in prod. 2023-11-27 12:09:34 -05:00
ArEnSc b99756a7d1 Merge pull request #165 from storytold/nov-27-mithoo
query builder quickfix
2023-11-27 11:23:13 -05:00
kasisnu dcbdaf9cd6 query builder quickfix 2023-11-27 17:47:55 +05:30
Michael Chung 8e4f419091 QiueryBuilder tests needed 2023-11-27 00:46:46 -05:00
Michael Chung b779946fe7 Queries pass need just some mock data to test it in the test.rs 2023-11-26 15:29:57 -05:00
Michael Chung a244e614cf need to run tests on the query builder then can work on the rest of the code 2023-11-26 14:22:42 -05:00
Michael Chung 2e6708168b building wip ... then test then endpoints probably need seed data for this that is a bit diverse. 2023-11-25 03:53:19 -05:00
Michael Chung 8c46f47352 queries building is wip. 2023-11-25 03:28:34 -05:00
Michael Chung fdbf028743 test works query builder now. 2023-11-25 02:40:46 -05:00
Michael Chung becf58a357 Time to test. 2023-11-25 01:51:02 -05:00
Michael Chung a4c227a4ca Fixes to the weights now need filter 2023-11-25 01:40:54 -05:00
Michael Chung 0e1e8a87f1 Mapping list_weights_by_user.rs done need filter and then test 2023-11-25 00:17:58 -05:00
Michael Chung c9df278d40 weights_queries list weights by user more testing and implementation needed 2023-11-24 23:50:50 -05:00
Michael Chung ddb35c5133 Added more data for seeding
Added to test lists need to get list_weights_by_user tested
2023-11-24 22:24:34 -05:00
Michael Chung df3fc1bf51 more tests undelete and delete. 2023-11-24 00:35:43 -05:00
Michael Chung 21f2c3ac78 fixed weights queries get_weight hardcode transform 2023-11-24 00:19:21 -05:00
Michael Chung be429017eb Deleting weights from the database works for user 2023-11-23 23:34:14 -05:00
Michael Chung 2a623bd8eb Ok just mapped this by hand, super dissapointed that I can't use the the proper way to do it for some unknown reason. 2023-11-23 22:46:28 -05:00
Michael Chung 8b2765ba65 Weight types is failing to serialize :S 2023-11-23 21:39:42 -05:00
Michael Chung ccf1adae61 Add a test mod 2023-11-23 21:22:23 -05:00
Michael Chung 1a144ac8cf Writing unit tests for the queries 2023-11-23 19:41:33 -05:00
Brandon Thomas 71581978ff Merge pull request #162 from storytold/nov-21-mithoo
Bump actix & futures deps
2023-11-23 12:49:39 -05:00
Michael Chung ce3aa6be74 model_weights delete need tests 2023-11-23 01:09:17 -05:00
Michael Chung f63eb94ed7 update_weight needs testing 2023-11-23 00:46:11 -05:00
kasisnu a987ae81cf rebase codegen updates 2023-11-23 11:10:57 +05:30
kasisnu 684cd7df69 upgrade futures 2023-11-23 11:08:29 +05:30
kasisnu 703e297b94 easy bump actix deps 2023-11-23 11:08:29 +05:30
Michael Chung 2e4e109065 Notes 2023-11-22 23:41:16 -05:00
Michael Chung 8481d37167 Fixed compile errors. 2023-11-22 23:25:19 -05:00
Michael Chung 5ed397af4e WIP get and update gotta write unit tests, WIP do not review. 2023-11-22 23:05:25 -05:00
Michael Chung ccbc89fd3e Fix function name issues 2023-11-22 13:21:52 -05:00
Brandon Thomas 62ce6d5991 codegen db 2023-11-22 03:07:13 -05:00
Brandon Thomas e27871bd7e Mark everything about BucketPathUnifier as deprecated. It sucks. 2023-11-22 02:27:48 -05:00
Brandon Thomas 106e3badc1 Merge pull request #163 from storytold/brandon-inference-job-startup-cleanup
Scoped inference jobs shouldn't require all parameters
2023-11-22 02:21:55 -05:00
Brandon Thomas bcc91080e6 reorganize dependencies 2023-11-22 02:20:11 -05:00
Brandon Thomas 9848688a69 make container startup easier to parse 2023-11-21 22:45:04 -05:00
Brandon Thomas 5e2f85964c vits dependencies 2023-11-21 22:18:32 -05:00
Brandon Thomas 8c17cd4415 vall-e-x dependencies 2023-11-21 21:54:32 -05:00
Brandon Thomas 58ce32dcbb tacotron2 2023-11-21 21:45:55 -05:00
Brandon Thomas 2856be7aa9 SadTalker dependencies 2023-11-21 21:34:32 -05:00
Brandon Thomas a28ef00618 cleanup job stubs we never implemented 2023-11-21 21:24:18 -05:00
Brandon Thomas 4941278590 SVC simplification 2023-11-21 20:06:33 -05:00
Michael Chung 5893753e35 Weights operations 2023-11-21 19:34:26 -05:00
Brandon Thomas 31ee410ac0 Cleanup Inference Job startup
- Don't require all env vars for all job types
2023-11-21 18:47:24 -05:00
Brandon Thomas c256b14fe5 Merge pull request #158 from storytold/dependabot/cargo/tempfile-3.8.1
Bump tempfile from 3.3.0 to 3.8.1
2023-11-21 18:07:46 -05:00
Brandon Thomas a2bd688ec2 Merge pull request #150 from storytold/dependabot/cargo/rustix-0.37.27
Bump rustix from 0.37.13 to 0.37.27
2023-11-21 18:07:20 -05:00
Brandon Thomas 2410be28c1 Merge pull request #159 from storytold/dependabot/cargo/num-traits-0.2.17
Bump num-traits from 0.2.15 to 0.2.17
2023-11-21 18:07:00 -05:00
Brandon Thomas a1191aa2c3 Merge pull request #95 from storytold/oct-12-mithoo
super basic favorites impl
2023-11-21 18:03:58 -05:00
Brandon Thomas 2c502359a4 user favorites, entity favorites, etc. + minor changes 2023-11-21 18:02:32 -05:00
kasisnu 18bd819da2 zsvoice & VC models can be favorited 2023-11-21 14:59:28 -05:00
kasisnu 2614ba5eb9 remove ip address fields, and be able to favorite media files 2023-11-21 14:59:28 -05:00
kasisnu b2bdf16c1c update postman collection w/favoritesc 2023-11-21 14:59:27 -05:00
kasisnu b436b07955 super basic favorites impl 2023-11-21 14:59:27 -05:00
Brandon Thomas 5da5908bea Merge pull request #109 from storytold/oct-19-mithoo
delete media files/basic update handler
2023-11-21 13:24:22 -05:00
Brandon Thomas 58ea502400 Delete/update tweaks 2023-11-21 13:22:59 -05:00
kasisnu 3ed1f36e36 rebase updates with sqlx codegen 2023-11-21 13:14:43 -05:00
kasisnu f958667cc4 delete media files/basic update handler 2023-11-21 13:14:43 -05:00
Kasisnu 87202f3ba2 Merge pull request #161 from storytold/nov-21-mithoo
disable speedup experiments on main workflows
2023-11-21 18:38:22 +05:30
kasisnu b59bdc1ed5 disable speedup experiments on main workflows 2023-11-21 18:37:54 +05:30
Kasisnu b68c7f415f Merge pull request #160 from storytold/nov-21-mithoo
add new workflow
2023-11-21 13:34:53 +05:30
kasisnu a08ebffeba add new workflow 2023-11-21 13:33:20 +05:30
dependabot[bot] 7893acce0f Bump num-traits from 0.2.15 to 0.2.17
Bumps [num-traits](https://github.com/rust-num/num-traits) from 0.2.15 to 0.2.17.
- [Changelog](https://github.com/rust-num/num-traits/blob/master/RELEASES.md)
- [Commits](https://github.com/rust-num/num-traits/compare/num-traits-0.2.15...num-traits-0.2.17)

---
updated-dependencies:
- dependency-name: num-traits
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-20 22:34:28 +00:00
dependabot[bot] 5dd3f7bf20 Bump tempfile from 3.3.0 to 3.8.1
Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.3.0 to 3.8.1.
- [Changelog](https://github.com/Stebalien/tempfile/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Stebalien/tempfile/commits)

---
updated-dependencies:
- dependency-name: tempfile
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-20 22:33:55 +00:00
Kasisnu f8a3a3b721 Merge pull request #157 from storytold/nov-20-mithoo
gpu build: copy result bins from updated directories
2023-11-20 15:47:35 +05:30
kasisnu 5895dc0b1f gpu build: copy result bins from updated directories 2023-11-20 15:47:15 +05:30
kasisnu 75e19113da x86_64-unknown-linux-musl -> x86_64-unknown-linux-gnu 2023-11-20 15:38:14 +05:30
Kasisnu a7dcdf19ed Merge pull request #156 from storytold/nov-20-mithoo
add --target=x86_64-unknown-linux-musl explicitly
2023-11-20 15:27:56 +05:30
kasisnu 8e415770fb Merge remote-tracking branch 'origin/master' into nov-20-mithoo 2023-11-20 15:26:46 +05:30
kasisnu 28d64f29e2 sadpanda 2023-11-20 15:26:17 +05:30
Kasisnu 9da6be3320 Merge pull request #155 from storytold/nov-20-mithoo
statically build gpu binaries
2023-11-20 15:20:28 +05:30
kasisnu 49cec49844 statically build gpu binaries 2023-11-20 15:19:27 +05:30
Brandon Thomas a2354cd64c install rsync in containers (lazy, fix this)
This was a lazy way to add rsync into the containers to enable easy
copying of files + logging. This is not the ideal way to do this.
2023-11-20 01:20:09 -05:00
Kasisnu 809dabd253 Merge pull request #154 from storytold/nov-20-mithoo
trailing slash
2023-11-20 11:22:11 +05:30
kasisnu 0470811bb4 trailing slash 2023-11-20 11:21:50 +05:30
Kasisnu fecb671400 Merge pull request #153 from storytold/nov-20-mithoo
sqlx codegen
2023-11-20 11:12:50 +05:30
kasisnu 6d82cb9de6 updated dockerfiles for sqlx codegen 2023-11-20 11:11:44 +05:30
kasisnu 0fdacfe295 sqlx codegen 2023-11-20 10:55:43 +05:30
Brandon Thomas 6a255330b4 Merge pull request #152 from storytold/brandon-rustls
Switch from native TLS to rustls
2023-11-20 00:10:20 -05:00
Brandon Thomas e64fcab028 Switch from native TLS to rustls
This should make for smaller and simpler binaries.
2023-11-20 00:06:15 -05:00
Michael Chung 6026748563 Seeding Weights probably actually need real weights 2023-11-19 23:36:59 -05:00
dependabot[bot] 6cd48d2f5b Bump rustix from 0.37.13 to 0.37.27
Bumps [rustix](https://github.com/bytecodealliance/rustix) from 0.37.13 to 0.37.27.
- [Release notes](https://github.com/bytecodealliance/rustix/releases)
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.37.13...v0.37.27)

---
updated-dependencies:
- dependency-name: rustix
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-20 04:34:25 +00:00
Brandon Thomas b36283c76e Merge pull request #149 from storytold/brandon-upgrade-sqlx-0.7.2
Upgrade sqlx to latest (0.7.2)
2023-11-19 23:32:22 -05:00
Brandon Thomas bd4644098f Upgrade sqlx to latest (0.7.2)
Hypothetically this unblocks native rustls over IP address. If so, we
can drop native OpenSSL and Ubuntu packages and make a much simpler
build.

See this issue:
https://github.com/launchbadge/sqlx/issues/1095#issuecomment-798050828

Had to deal with a few migration issues,

- changes to transactor types:
  https://github.com/launchbadge/sqlx/issues/2606

- changes to sqlx_core that impacted our serialization/deserialization macros
2023-11-19 23:25:52 -05:00
Brandon Thomas 831b0eda29 Don't need this - let's invert the pod in control 2023-11-18 23:47:52 -05:00
Michael Chung bffe8d39ae model_weights/create_weight.rs being worked on 2023-11-18 00:44:41 -05:00
Michael Chung c36ca5e73c create model_weights 2023-11-17 23:59:53 -05:00
Michael Chung 55344fc6dd Model Weight Queries has to be worked on categories and types tests written. 2023-11-17 23:39:55 -05:00
Brandon Thomas 0a9803af83 PLEAAASE BUILD 2023-11-17 11:29:27 -05:00
Brandon Thomas 0952d16a86 -y flag ? 2023-11-17 11:08:43 -05:00
Brandon Thomas 2ed43572e0 maybe patch 3.8 logger too 2023-11-17 10:34:16 -05:00
Brandon Thomas 72e67ed198 really install deadsnakes 2023-11-17 10:21:18 -05:00
Brandon Thomas 66774b0d31 python3.8 (this should only be temporary) 2023-11-17 10:14:04 -05:00
Brandon Thomas d54cd75dec unblock route 2023-11-17 08:48:13 -05:00
Brandon Thomas 23293e973f codegen db 2023-11-17 03:42:01 -05:00
Brandon Thomas 5bb32d0adb record millis and encoding 2023-11-17 03:16:40 -05:00
Brandon Thomas d123a73069 confirm email when password reset 2023-11-17 02:48:24 -05:00
Brandon Thomas f978c1f4cc propagate avt to zero shot tts 2023-11-17 02:39:55 -05:00
Brandon Thomas 9d38440ae4 rename handler 2023-11-17 01:52:10 -05:00
Brandon Thomas 4530083333 more foreign key and field completion for samples 2023-11-17 01:49:03 -05:00
Brandon Thomas 23584b4462 Merge pull request #148 from storytold/brandon-vallex-pathing
Fix vallex pathing
2023-11-16 21:03:50 -05:00
Brandon Thomas 762cf2d0b4 pathing works 2023-11-16 21:02:54 -05:00
Brandon Thomas 7a4c035960 upload of weights works 2023-11-16 20:32:19 -05:00
Brandon Thomas cd8ca0092b modify bucket pathing 2023-11-16 20:07:14 -05:00
Brandon Thomas c920ae5286 Merge pull request #147 from storytold/bt-split-vallex-to-files
split vallex tts inference + embedding creation
2023-11-16 19:06:55 -05:00
Brandon Thomas 61bb4162a3 split vallex tts inference + embedding creation 2023-11-16 19:06:16 -05:00
Brandon Thomas a1c7db19e3 Merge pull request #146 from storytold/bt-better-error-logging-vallex
better error logging, pathing
2023-11-16 18:53:41 -05:00
Brandon Thomas e6690fa133 better error logging, pathing 2023-11-16 18:52:56 -05:00
Brandon Thomas c22f7fe654 Merge pull request #138 from storytold/dependabot/cargo/magic-crypt-3.1.13
Bump magic-crypt from 3.1.8 to 3.1.13
2023-11-16 17:56:54 -05:00
Brandon Thomas bc94582138 Merge pull request #140 from storytold/dependabot/cargo/strum-0.25.0
Bump strum from 0.24.1 to 0.25.0
2023-11-16 17:56:18 -05:00
Brandon Thomas b3226b04cb Merge pull request #139 from storytold/dependabot/cargo/serde_json-1.0.108
Bump serde_json from 1.0.91 to 1.0.108
2023-11-16 17:56:05 -05:00
Michael Chung afc0e27fb4 Made updates to the seed and the docs to reflect the new seed files. 2023-11-16 16:07:50 -05:00
Brandon Thomas f338d57ef5 Merge pull request #145 from storytold/bt-zs-inference-cleanup
voice designer inference job cleanup
2023-11-16 15:01:26 -05:00
Brandon Thomas 419c202ec9 voice designer inference job cleanup
- paths were different between upload, inference, and seed tool
- errors aren't being appropriately handled (and there's still work to
  do here)
2023-11-16 05:10:30 -05:00
dependabot[bot] 59c19b2927 Bump strum from 0.24.1 to 0.25.0
Bumps [strum](https://github.com/Peternator7/strum) from 0.24.1 to 0.25.0.
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Peternator7/strum/commits)

---
updated-dependencies:
- dependency-name: strum
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-16 06:18:28 +00:00
dependabot[bot] 3adf92d4e5 Bump serde_json from 1.0.91 to 1.0.108
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.91 to 1.0.108.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.91...v1.0.108)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-16 06:17:36 +00:00
Brandon Thomas 04e2605240 fixup lint / test failures 2023-11-16 01:16:09 -05:00
Brandon Thomas 6186dcd89d analytics on password resets 2023-11-16 01:06:03 -05:00
Brandon Thomas 0f3586746e committing secrets is a sin 2023-11-16 00:45:47 -05:00
Brandon Thomas f84c31de5b success response fields 2023-11-16 00:03:01 -05:00
Brandon Thomas a19cafbae0 parameterize SMTP account 2023-11-15 23:55:34 -05:00
Brandon Thomas b45afab5ea stupid fix 2023-11-15 23:18:41 -05:00
Brandon Thomas 6d24b4b49b codegen db 2023-11-15 22:47:20 -05:00
Brandon Thomas f9704f0da4 Merge pull request #144 from storytold/brandon-email-job
email-job
2023-11-15 22:34:43 -05:00
Brandon Thomas c7c7c5b798 email-job 2023-11-15 22:31:18 -05:00
Brandon Thomas 462ed87a7b Merge pull request #132 from storytold/brandon-model-weights
WIP / DNM - model_weights
2023-11-15 21:03:02 -05:00
Brandon Thomas 170f6772d7 rename migrations for better operational sequencing 2023-11-15 21:02:11 -05:00
Brandon Thomas 2b884ebe51 Move metadata into polymorphic join tables 2023-11-15 21:00:41 -05:00
Brandon Thomas fec587d81e "model_weights" to replace all of the various weights tables 2023-11-15 21:00:39 -05:00
dependabot[bot] 4aec1a2298 Bump magic-crypt from 3.1.8 to 3.1.13
Bumps [magic-crypt](https://github.com/magiclen/rust-magiccrypt) from 3.1.8 to 3.1.13.
- [Commits](https://github.com/magiclen/rust-magiccrypt/compare/v3.1.8...v3.1.13)

---
updated-dependencies:
- dependency-name: magic-crypt
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-16 01:31:31 +00:00
Brandon Thomas 1e3117789e Merge pull request #143 from storytold/nov-15-mithoo
build fix, get endpoints for zs datasets/voices
2023-11-15 20:30:11 -05:00
kasisnu a18ebc4db3 get endpoints for zs datasets & voices 2023-11-15 14:26:57 +05:30
kasisnu 6cc75df103 Merge remote-tracking branch 'origin/speedup-experiments' into nov-15-mithoo 2023-11-15 11:19:45 +05:30
kasisnu 297ce4e0ad add hakari dep to dockerfile 2023-11-14 12:46:43 +05:30
kasisnu 235c0d6754 fix missing deps 2023-11-14 12:42:28 +05:30
Kasisnu 8cd8f45b6c Merge pull request #142 from storytold/nov-12-mithoo
removing some unused creates
2023-11-14 12:37:04 +05:30
kasisnu ee0526f499 add a second branch to test speedups 2023-11-14 12:35:50 +05:30
kasisnu d84e497131 hakari deps 2023-11-14 12:32:54 +05:30
kasisnu 2eb5635c58 removing some unused creates 2023-11-14 12:31:37 +05:30
Brandon Thomas dd3c87b712 don't leak accounts 2023-11-12 07:02:39 -05:00
Brandon Thomas 7dc7afd244 environmental reset link 2023-11-12 05:16:53 -05:00
Brandon Thomas f1d3566f30 login after password reset 2023-11-12 04:24:47 -05:00
Brandon Thomas 3852851f65 'success' fields, cleanup 2023-11-12 02:52:26 -05:00
Brandon Thomas bdd24c47fa codegen db 2023-11-12 02:36:29 -05:00
Brandon Thomas a31a72abb7 Merge pull request #137 from storytold/brandon-jake-password-reset
password reset
2023-11-12 02:27:56 -05:00
Brandon Thomas 34c90becbb schema migrations for password reset 2023-11-12 02:26:38 -05:00
Brandon Thomas a69d0f7b9a redemption works 2023-11-11 19:56:23 -05:00
Brandon Thomas e068af0e1c wip redemption 2023-11-11 16:23:30 -05:00
Brandon Thomas c6a111bb4c smtp wired up 2023-11-11 14:53:58 -05:00
Brandon Thomas 9ce771f571 fix crockford-encoded entropy 2023-11-10 16:27:30 -05:00
Jacob Conley 5892fb1f14 Fixed implementation up to the point of sending the email 2023-11-10 16:14:24 -05:00
Jacob Conley 6bbf8a9b01 Changed e-mail library; still only partially implemented 2023-11-10 16:14:21 -05:00
Jacob Conley 16d6542911 Beginning password reset implementation
- Email send is not implemented yet
 - All of this is still untested, clearly
2023-11-10 16:13:58 -05:00
Jacob Conley 1cc3c5eee4 Update more crockford_deprecated stuff for real this time 2023-11-10 16:12:42 -05:00
Jacob Conley 054d7db0a9 Update crockford_deprecated references 2023-11-10 16:12:41 -05:00
Jacob Conley 927337331e Rename crockford crate to crockford_deprecated - Gotta update references 2023-11-10 16:12:41 -05:00
Kasisnu 50780926fb Merge pull request #136 from storytold/nov-10-mithoo
fix various stripe handler errors :(
2023-11-10 15:05:33 +05:30
kasisnu 2ebd6dc634 fix various stripe handler errors :( 2023-11-10 15:05:02 +05:30
Kasisnu c5d5a4ba08 Merge pull request #135 from storytold/nov-10-mithoo
feat: report errors to stripe
2023-11-10 13:59:40 +05:30
kasisnu 797332b887 feat: report errors to stripe 2023-11-10 13:59:19 +05:30
Kasisnu 30d71ad605 Merge pull request #134 from storytold/nov-10-mithoo
audio mp4 uploads on ios
2023-11-10 13:47:15 +05:30
kasisnu 889121a818 audio mp4 uploads on ios 2023-11-10 13:46:39 +05:30
Brandon Thomas 293f531a79 Merge pull request #133 from storytold/lru-delete-models
Delete models from AWS EFS host
2023-11-10 00:36:21 -05:00
Brandon Thomas fc344557be Delete models from AWS EFS host 2023-11-10 00:35:36 -05:00
Brandon Thomas a34785c308 Merge pull request #128 from storytold/dependabot/cargo/hyper-0.14.24
Bump hyper from 0.13.10 to 0.14.24
2023-11-09 13:44:41 -05:00
Brandon Thomas 7d6aec158c Merge pull request #114 from storytold/dependabot/cargo/derive_more-0.99.17
Bump derive_more from 0.99.14 to 0.99.17
2023-11-09 13:42:14 -05:00
Brandon Thomas 861faafe60 Merge pull request #127 from storytold/dependabot/cargo/subprocess-0.2.9
Bump subprocess from 0.2.7 to 0.2.9
2023-11-09 13:42:05 -05:00
Brandon Thomas 5240d3cde5 Merge pull request #129 from storytold/dependabot/cargo/futures-util-0.3.29
Bump futures-util from 0.3.28 to 0.3.29
2023-11-09 13:41:56 -05:00
Brandon Thomas 8b962dcf6d notes on vocoder_models table 2023-11-09 00:45:30 -05:00
dependabot[bot] e2c3aedfb8 Bump hyper from 0.13.10 to 0.14.24
Bumps [hyper](https://github.com/hyperium/hyper) from 0.13.10 to 0.14.24.
- [Release notes](https://github.com/hyperium/hyper/releases)
- [Changelog](https://github.com/hyperium/hyper/blob/v0.14.24/CHANGELOG.md)
- [Commits](https://github.com/hyperium/hyper/compare/v0.13.10...v0.14.24)

---
updated-dependencies:
- dependency-name: hyper
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-08 17:31:45 +00:00
dependabot[bot] e9605ea6af Bump futures-util from 0.3.28 to 0.3.29
Bumps [futures-util](https://github.com/rust-lang/futures-rs) from 0.3.28 to 0.3.29.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.28...0.3.29)

---
updated-dependencies:
- dependency-name: futures-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-08 17:31:22 +00:00
Brandon Thomas c6c708827b Merge pull request #131 from storytold/nov-08-mithoo
bump async-stripe, dealing with webhook handler failures/updates
2023-11-08 12:29:03 -05:00
kasisnu c9b3ce06d6 bump async-stripe, dealing with webhook handler failures/updates 2023-11-08 15:17:06 +05:30
Kasisnu e4faf58990 Merge pull request #130 from storytold/nov-08-mithoo
iphone audio mimetype
2023-11-08 12:08:58 +05:30
kasisnu d77c5e1885 iphone audio mimetype 2023-11-08 12:08:17 +05:30
Brandon Thomas 4930629a3a fix lint and test failures 2023-11-07 22:33:38 -05:00
Brandon Thomas 331a0ce518 codegen db 2023-11-07 21:55:31 -05:00
Brandon Thomas 7aaa70bb31 more voice takedowns 2023-11-07 21:41:02 -05:00
Brandon Thomas 81d54291d1 Add README notes for Mac; streamline README 2023-11-02 01:14:48 -04:00
Brandon Thomas 77a2cc3439 dynamically flag off voice designer in production 2023-11-01 05:47:59 -04:00
Brandon Thomas 2882128a5c todo 2023-11-01 04:38:06 -04:00
Brandon Thomas 0150715d63 setup for Windows Subsystem for Linux 2023-11-01 02:38:08 -04:00
Brandon Thomas d63f5a8728 reorganize readme 2023-10-31 22:49:23 -04:00
dependabot[bot] dcd77e53aa Bump subprocess from 0.2.7 to 0.2.9
Bumps [subprocess](https://github.com/hniksic/rust-subprocess) from 0.2.7 to 0.2.9.
- [Commits](https://github.com/hniksic/rust-subprocess/compare/release/0.2.7...release/0.2.9)

---
updated-dependencies:
- dependency-name: subprocess
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-30 23:12:08 +00:00
Brandon Thomas 10ce570aa9 Merge pull request #126 from storytold/brandon-zs-endpoint-refinement
Brandon zs endpoint refinement
2023-10-30 18:29:43 -04:00
Brandon Thomas fa3244c72b fix iPhone audio/mp4 bug 2023-10-30 15:12:42 -04:00
Brandon Thomas 7a6a3840c3 return more fields on "list all voices" 2023-10-30 04:26:39 -04:00
Brandon Thomas 30760e29d6 list datasets by session handler; more cleanup 2023-10-30 04:14:55 -04:00
Brandon Thomas 3c025c506e add "list voices by session" endpoint; misc cleanup 2023-10-30 03:41:56 -04:00
Brandon Thomas 8dd5661923 remove more 2023-10-29 12:39:35 -04:00
Brandon Thomas 0bcdaa0d2d missed one 2023-10-29 12:35:20 -04:00
Brandon Thomas c5efc9e0c8 RVC takedown requests 2023-10-29 12:33:45 -04:00
Brandon Thomas b8c85b7e91 minor tweak to threading 2023-10-28 20:52:30 -04:00
Brandon Thomas 29e556c311 rename with kebob-case 2023-10-28 20:27:02 -04:00
Brandon Thomas dc735c01a0 rust 1.66 -> 1.73 (required update) 2023-10-27 06:13:06 -04:00
Brandon Thomas 7d66279d70 fix nits 2023-10-27 06:09:21 -04:00
Brandon Thomas d6de7acc5c codegen db 2023-10-27 05:58:34 -04:00
Brandon Thomas 5da6cee74c Merge pull request #124 from storytold/brandon-elasticsearch
Introduce elasticsearch database + tools
2023-10-27 05:56:20 -04:00
Brandon Thomas e4607fe658 Introduce elasticsearch database + tools 2023-10-27 05:56:00 -04:00
Brandon Thomas 4def45d769 Merge pull request #123 from storytold/brandon-revert-sha2-upgrade
Revert "Bump sha2 from 0.9.5 to 0.10.5"
2023-10-26 00:01:30 -04:00
Brandon Thomas b6f7f50b16 Revert "Bump sha2 from 0.9.5 to 0.10.5"
This reverts commit b9667e2540.
2023-10-25 23:52:40 -04:00
Brandon Thomas 8af1a2da47 Merge pull request #115 from storytold/dependabot/cargo/sha2-0.10.5
Bump sha2 from 0.9.5 to 0.10.5
2023-10-25 23:50:32 -04:00
dependabot[bot] 995c912e94 Bump derive_more from 0.99.14 to 0.99.17
Bumps [derive_more](https://github.com/JelteF/derive_more) from 0.99.14 to 0.99.17.
- [Release notes](https://github.com/JelteF/derive_more/releases)
- [Changelog](https://github.com/JelteF/derive_more/blob/master/CHANGELOG.md)
- [Commits](https://github.com/JelteF/derive_more/compare/v0.99.14...v0.99.17)

---
updated-dependencies:
- dependency-name: derive_more
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-26 03:50:14 +00:00
Brandon Thomas c018001693 Merge pull request #116 from storytold/dependabot/cargo/pulldown-cmark-0.9.3
Bump pulldown-cmark from 0.8.0 to 0.9.3
2023-10-25 23:48:38 -04:00
Brandon Thomas 3f54396ef4 Merge pull request #118 from storytold/dependabot/cargo/actix-http-3.4.0
Bump actix-http from 3.3.0 to 3.4.0
2023-10-25 23:48:14 -04:00
Brandon Thomas 85eed593d0 Merge pull request #122 from storytold/voice-designer-concrete-types
more concrete types for "enum"-like fields, remove unnecessary updates
2023-10-25 23:47:21 -04:00
Brandon Thomas 50a0cb298d more concrete types for "enum"-like fields, remove unnecessary updates 2023-10-25 23:39:42 -04:00
Brandon Thomas b11ad51d8e rename enum serialization 2023-10-25 17:01:17 -04:00
Brandon Thomas b0aae47328 rename some IdCategory enum values (not serializations) 2023-10-25 16:58:45 -04:00
Brandon Thomas a6c4c10a9a fix tests and lints 2023-10-25 16:46:19 -04:00
ArEnSc 7b31887891 Merge pull request #94 from storytold/feature/enqueue_tts_request
Feature/enqueue tts request
2023-10-25 11:58:31 -04:00
Michael Chung 8a5e4538a0 All good! going to merge now. 2023-10-25 11:32:22 -04:00
Brandon Thomas 37129a6d01 better documentation 2023-10-25 04:04:51 -04:00
Brandon Thomas 7731c534a3 restructure tokens package to organize prefixes
Tests enforce the new style, which wasn't possible before
2023-10-25 03:57:19 -04:00
dependabot[bot] b9667e2540 Bump sha2 from 0.9.5 to 0.10.5
Bumps [sha2](https://github.com/RustCrypto/hashes) from 0.9.5 to 0.10.5.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.5...sha2-v0.10.5)

---
updated-dependencies:
- dependency-name: sha2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-25 07:03:42 +00:00
Brandon Thomas 9aeca4aa90 Finally 'Tokens::' methods are dead! 2023-10-25 03:02:14 -04:00
Brandon Thomas f40a292b1e todo 2023-10-25 00:59:27 -04:00
Brandon Thomas d90df6f8b8 change billing token to typed token 2023-10-25 00:55:54 -04:00
Brandon Thomas 92c76d2bb9 get rid of more legacy tokens 2023-10-25 00:49:12 -04:00
Brandon Thomas 9b5bb16358 continue getting rid of Token in the mysql package 2023-10-25 00:14:11 -04:00
Brandon Thomas 03135fa781 investigate use of face animator 2023-10-24 23:48:13 -04:00
Michael Chung 3f70ca72dd Dev environment
Fixed various code problems, going to merge soon.
2023-10-24 13:09:36 -04:00
Michael Chung d8a4b6c735 Get everything to build again we have to merge soon. 2023-10-24 11:26:12 -04:00
Michael Chung 48ed6d118c Merge issues with VSCode? this is strange .... 2023-10-24 11:15:31 -04:00
Michael Chung 4c3ac3edda Merge branch 'master' into feature/enqueue_tts_request 2023-10-24 10:20:37 -04:00
Brandon Thomas dae5764658 codegen queries 2023-10-24 05:40:33 -04:00
Brandon Thomas 98547df063 propagate avt from jobs to media_files 2023-10-24 05:12:42 -04:00
Brandon Thomas 9c856235fc write avt cookie token to inference jobs 2023-10-24 05:04:00 -04:00
Brandon Thomas 205f6de1b2 fix lint failures 2023-10-24 04:20:38 -04:00
Brandon Thomas a9fa45575e additional comment 2023-10-24 04:07:02 -04:00
Brandon Thomas 1b77974a0e change user token prefix 2023-10-24 04:06:33 -04:00
Brandon Thomas 724ae2570e How did this ever work!? 2023-10-24 03:56:38 -04:00
Brandon Thomas dc7b5b7e60 Merge pull request #120 from storytold/echelon-terminate-job-endpoint
endpoint to terminate jobs
2023-10-24 02:41:03 -04:00
Brandon Thomas 3259433717 endpoint to terminate jobs 2023-10-24 02:40:00 -04:00
Brandon Thomas bc5d84a306 use the new job status enum 2023-10-24 01:22:48 -04:00
Brandon Thomas 2357f00944 Merge pull request #119 from storytold/echelon-job-system-new-states
Introduce two new job status types to generic inference jobs
2023-10-24 01:08:15 -04:00
Brandon Thomas 24127f20e4 Introduce two new job status types to generic inference jobs 2023-10-24 01:06:14 -04:00
Brandon Thomas 4c8f14d4d5 Migration to make password_resets.ip_address_redemption nullable 2023-10-23 22:11:26 -04:00
Brandon Thomas e14440ba02 undo edit to previous migration (should be harmless in prod) 2023-10-23 22:05:11 -04:00
Michael Chung 7295a3295f Fix prefixes for create and inference 2023-10-23 22:03:37 -04:00
Michael Chung 10176079c7 remove variables not used 2023-10-23 21:59:26 -04:00
Michael Chung 8999a80e92 Change root ml dir 2023-10-23 21:34:58 -04:00
Michael Chung 41b07049ff Remove comments 2023-10-23 21:29:41 -04:00
Michael Chung b45f6ed691 Restore storyteller rust root for dev_database_seed 2023-10-23 21:25:04 -04:00
Michael Chung 9d16eb05c1 Fix data seed env-secrets path. 2023-10-23 21:13:27 -04:00
Michael Chung b414540251 Fixing issue with the origin model type along side tests. 2023-10-23 21:11:00 -04:00
Michael Chung 2949456adc Restore bad merge on id_category.rs 2023-10-23 21:07:35 -04:00
dependabot[bot] 02d06df0e2 Bump actix-http from 3.3.0 to 3.4.0
Bumps [actix-http](https://github.com/actix/actix-web) from 3.3.0 to 3.4.0.
- [Release notes](https://github.com/actix/actix-web/releases)
- [Changelog](https://github.com/actix/actix-web/blob/master/CHANGES.md)
- [Commits](https://github.com/actix/actix-web/compare/web-v3.3.0...http-v3.4.0)

---
updated-dependencies:
- dependency-name: actix-http
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-23 22:31:41 +00:00
dependabot[bot] b89ef1fe20 Bump pulldown-cmark from 0.8.0 to 0.9.3
Bumps [pulldown-cmark](https://github.com/raphlinus/pulldown-cmark) from 0.8.0 to 0.9.3.
- [Release notes](https://github.com/raphlinus/pulldown-cmark/releases)
- [Commits](https://github.com/raphlinus/pulldown-cmark/compare/v0.8.0...v0.9.3)

---
updated-dependencies:
- dependency-name: pulldown-cmark
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-23 22:30:59 +00:00
Michael Chung 3a72292898 Some minor comment fix 2023-10-23 16:54:27 -04:00
Michael Chung 07c640ce84 Retest the endpoints with the correct credentials
One more integration test with multiple wav files.
2023-10-23 16:52:31 -04:00
Michael Chung 49a15fd1f1 Cleaning up some of the end points. 2023-10-23 16:22:37 -04:00
Michael Chung 3267f9949d Added ip address and creator token. 2023-10-23 16:02:07 -04:00
Michael Chung 47df6930d2 Basically works well!
Few things to checkout.
2023-10-22 23:38:31 -04:00
Michael Chung 913d282d60 Fixed extensions on create
Checking whether media uploads.
2023-10-22 20:52:57 -04:00
Michael Chung 743934ff50 Need to do a clean up then check media upload and table 2023-10-22 20:36:32 -04:00
Michael Chung bc209fe939 So the prefix wasn't populated in the seed I think! 2023-10-22 17:57:35 -04:00
Michael Chung 302975ddfd Seeded db testing again 2023-10-22 11:57:29 -04:00
Michael Chung d7664e8e1c Merge branch 'master' into feature/enqueue_tts_request 2023-10-21 02:41:43 -04:00
Michael Chung 9f7fc09e9f Builds testing. 2023-10-21 01:13:39 -04:00
Michael Chung 2686cb94e0 Testing create command now. 2023-10-21 00:28:11 -04:00
Michael Chung fd7f1e1893 testing now. 2023-10-20 23:27:31 -04:00
Brandon Thomas eb3499596e always output stderr 2023-10-20 14:45:03 -04:00
Michael Chung 00bfdad3d0 Test pass! 2023-10-20 12:13:57 -04:00
Michael Chung ff3821956a Builds again 2023-10-20 11:43:16 -04:00
Michael Chung a5a5f5473b Testing! 2023-10-20 10:13:23 -04:00
Brandon Thomas 7c553ffcee fix rvc jobs 2023-10-20 07:00:09 -04:00
Brandon Thomas 52f0b44c26 codegen db 2023-10-20 06:14:49 -04:00
Brandon Thomas fbed7cd530 Merge pull request #113 from storytold/echelon-voice-conversion-media-files
voice conversion --> media files
2023-10-20 06:14:19 -04:00
Brandon Thomas 4ce8752a6a codegen db 2023-10-20 06:12:41 -04:00
Brandon Thomas 3239e318b1 fix inference job status links 2023-10-20 05:37:51 -04:00
Brandon Thomas 471dcff697 RVC -> media_files 2023-10-20 05:14:00 -04:00
Brandon Thomas 2af57fcf3e Write voice conversion results to media_files tables 2023-10-20 05:14:00 -04:00
Brandon Thomas f2b0e77210 fix stupid "1" bug on generic jobs 2023-10-20 05:13:44 -04:00
Michael Chung 10c8bc1ef3 Just need to run inference and pass the insert the record and upload the voice once it infers.
Run the path test.
2023-10-20 01:46:13 -04:00
Brandon Thomas 35dfe6a7f2 fix lints 2023-10-20 01:09:56 -04:00
Brandon Thomas 48ecc44978 Merge pull request #112 from storytold/echelon-seed-samples
Update seed tool to seed and upload samples
2023-10-19 22:36:30 -04:00
Brandon Thomas 4f0e2d5f72 Update seed tool to seed and upload samples 2023-10-19 22:33:24 -04:00
Brandon Thomas 96c99fd102 Merge pull request #111 from storytold/echelon-media-file-upload-cli
CLI tool to upload media files and save them to the DB
2023-10-19 21:56:38 -04:00
Brandon Thomas 26794b3d2e CLI tool to upload media files and save them to the DB 2023-10-19 21:52:32 -04:00
Michael Chung c3a60ed8ab Merge branch 'master' into feature/enqueue_tts_request 2023-10-19 20:12:40 -04:00
Michael Chung 13964901f0 update process job created a fork for creating voice 2023-10-19 19:19:53 -04:00
Brandon Thomas 593fb50fcb Merge pull request #110 from storytold/echelon-list-dataset-samples
Enrich list dataset samples query + endpoint with bucket information
2023-10-19 18:24:39 -04:00
Brandon Thomas fff71d7aa4 Enrich list dataset samples query + endpoint with bucket information 2023-10-19 18:18:35 -04:00
Michael Chung 57eecb3757 Creating the create voice job 2023-10-19 16:26:43 -04:00
Brandon Thomas 022aa523cb fix cookie paths ? 2023-10-19 05:56:15 -04:00
Brandon Thomas 6d01506bd1 fix cookie path 2023-10-19 05:53:44 -04:00
Brandon Thomas 0cc3baee27 Merge pull request #108 from storytold/brandon-set-avt-cookie
Start setting AVT cookie on /v1/session endpoint
2023-10-19 05:06:00 -04:00
Brandon Thomas d5b28d2d3e Start setting AVT cookie on /v1/session endpoint 2023-10-19 04:24:50 -04:00
Brandon Thomas d6a3d4887f Merge pull request #107 from storytold/bt-revert-sha2-upgrade
Revert "Bump sha2 from 0.9.5 to 0.10.5"
2023-10-19 02:44:56 -04:00
Brandon Thomas cce4f5f3b7 Revert "Bump sha2 from 0.9.5 to 0.10.5"
This reverts commit 59f7b6f732.
2023-10-19 02:44:21 -04:00
Brandon Thomas 9123dbc3d9 Merge pull request #98 from storytold/dependabot/cargo/sha2-0.10.5
Bump sha2 from 0.9.5 to 0.10.5
2023-10-19 02:41:04 -04:00
Brandon Thomas d43a747033 Merge pull request #100 from storytold/dependabot/cargo/rpassword-7.2.0
Bump rpassword from 5.0.1 to 7.2.0
2023-10-19 02:40:25 -04:00
Brandon Thomas c3e5b42bf3 use JwtSigner for session cookie 2023-10-19 02:39:17 -04:00
Michael Chung 25cdbf2f1d Adding create voice command 2023-10-19 02:09:16 -04:00
dependabot[bot] 59f7b6f732 Bump sha2 from 0.9.5 to 0.10.5
Bumps [sha2](https://github.com/RustCrypto/hashes) from 0.9.5 to 0.10.5.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.5...sha2-v0.10.5)

---
updated-dependencies:
- dependency-name: sha2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-19 05:57:20 +00:00
dependabot[bot] fe7251744f Bump rpassword from 5.0.1 to 7.2.0
Bumps [rpassword](https://github.com/conradkleinespel/rpassword) from 5.0.1 to 7.2.0.
- [Release notes](https://github.com/conradkleinespel/rpassword/releases)
- [Commits](https://github.com/conradkleinespel/rpassword/compare/v5.0.1...v7.2.0)

---
updated-dependencies:
- dependency-name: rpassword
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-19 05:56:56 +00:00
Brandon Thomas fdd60b436a Merge pull request #99 from storytold/dependabot/cargo/scraper-0.17.1
Bump scraper from 0.14.0 to 0.17.1
2023-10-19 01:55:06 -04:00
Brandon Thomas 0836e88f4c Merge pull request #101 from storytold/dependabot/cargo/diesel-2.1.3
Bump diesel from 1.4.6 to 2.1.3
2023-10-19 01:54:46 -04:00
Brandon Thomas 261978f763 Merge pull request #102 from storytold/dependabot/cargo/anyhow-1.0.75
Bump anyhow from 1.0.40 to 1.0.75
2023-10-19 01:53:55 -04:00
Brandon Thomas d072e021d1 Merge pull request #106 from storytold/echelon-cookies
Cookie stuff - JWT signer, anonymous visitor cookies, etc.
2023-10-19 01:53:05 -04:00
Brandon Thomas 66442d9eda Cookie stuff - JWT signer, anonymous visitor cookies, etc.
- JWT signer is reusable, tested

- AVT cookies improve the anonymous user experience and will help
  internal analytics
2023-10-19 01:37:50 -04:00
Michael Chung 0f4cab9ca3 Added missing new file 2023-10-18 19:50:24 -04:00
Michael Chung 6de4d451ac Fixed import issues 2023-10-18 19:50:07 -04:00
Michael Chung 9d4e426ace It is now being tested then we work on the command side. 2023-10-18 18:02:30 -04:00
Michael Chung bfb5103f46 Merge branch 'master' into feature/enqueue_tts_request 2023-10-18 13:37:23 -04:00
Michael Chung 3308c05836 Need to pull master 2023-10-18 13:26:19 -04:00
Brandon Thomas 5a539e589d codegen db 2023-10-18 04:53:55 -04:00
Brandon Thomas 604c72179a password_resets needs a unique index on (user, secret_key) 2023-10-18 02:22:39 -04:00
Michael Chung be19eefa1a Upload and create record and were good to do the other command and clean up. 2023-10-18 02:13:59 -04:00
Michael Chung 34e2b1e544 It works runs inference_job
Need to upload the file then create the record for download
2023-10-18 02:03:41 -04:00
Brandon Thomas 95152e9a88 fix replacement paths 2023-10-18 00:31:43 -04:00
Michael Chung cbe8aaa1ba More fixes 2023-10-18 00:04:33 -04:00
Michael Chung 11185584a7 Fixing typos and virtual env 2023-10-17 22:56:30 -04:00
Michael Chung 76559cf783 fix the env 2023-10-17 22:11:22 -04:00
Michael Chung 2e7bd622f3 fixed a typo 2023-10-17 22:06:42 -04:00
Michael Chung 68048659d4 Testing inference_job 2023-10-17 22:00:14 -04:00
Brandon Thomas 608e94a6a8 Merge pull request #105 from storytold/echelon-config-path-substitution
Substitute config absolute paths with magic substitution strings
2023-10-17 21:38:06 -04:00
Brandon Thomas 9e0bee8fba Substitute config absolute paths with magic substitution strings 2023-10-17 21:37:20 -04:00
Brandon Thomas dcec9b9e8a Merge pull request #104 from storytold/echelon-storyteller-home
"storyteller root" directory in development
2023-10-17 21:12:51 -04:00
Brandon Thomas 3fc0f45942 "storyteller root" directory in development 2023-10-17 21:04:54 -04:00
Brandon Thomas bfd325900f Merge pull request #103 from storytold/echelon-better-envvars
Better env var support
2023-10-17 17:00:54 -04:00
Brandon Thomas 1ef7ae1009 Better env var support 2023-10-17 16:31:53 -04:00
Michael Chung 17d51f8d87 Merge branch 'master' into feature/enqueue_tts_request 2023-10-17 13:37:35 -04:00
Brandon Thomas ca81d1b543 fix build / lint errors 2023-10-16 20:02:41 -04:00
dependabot[bot] 1de3e669d6 Bump anyhow from 1.0.40 to 1.0.75
Bumps [anyhow](https://github.com/dtolnay/anyhow) from 1.0.40 to 1.0.75.
- [Release notes](https://github.com/dtolnay/anyhow/releases)
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.40...1.0.75)

---
updated-dependencies:
- dependency-name: anyhow
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-16 22:18:42 +00:00
dependabot[bot] ac39ac0a76 Bump diesel from 1.4.6 to 2.1.3
Bumps [diesel](https://github.com/diesel-rs/diesel) from 1.4.6 to 2.1.3.
- [Release notes](https://github.com/diesel-rs/diesel/releases)
- [Changelog](https://github.com/diesel-rs/diesel/blob/v2.1.3/CHANGELOG.md)
- [Commits](https://github.com/diesel-rs/diesel/compare/v1.4.6...v2.1.3)

---
updated-dependencies:
- dependency-name: diesel
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-16 22:18:25 +00:00
dependabot[bot] f9caa7d836 Bump scraper from 0.14.0 to 0.17.1
Bumps [scraper](https://github.com/causal-agent/scraper) from 0.14.0 to 0.17.1.
- [Release notes](https://github.com/causal-agent/scraper/releases)
- [Commits](https://github.com/causal-agent/scraper/compare/v0.14.0...v0.17.1)

---
updated-dependencies:
- dependency-name: scraper
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-16 22:17:50 +00:00
Michael Chung 5f7a10a54c Merge branch 'master' into feature/enqueue_tts_request 2023-10-16 09:34:46 -04:00
Brandon Thomas e478c73ddf Merge pull request #97 from storytold/echelon-sample-upload
Dataset sample upload (not yet tested, but compiles, and needs lots of cleanup)
2023-10-14 12:23:36 -04:00
Brandon Thomas 92676e842c Dataset sample upload 2023-10-14 12:18:42 -04:00
Michael Chung 7eee225296 Builds again need to clearify what happened to the download function 2023-10-13 15:36:21 -04:00
Michael Chung 1319471c04 Merge branch 'master' into feature/enqueue_tts_request 2023-10-13 10:02:17 -04:00
Brandon Thomas 47e7269880 codegen db 2023-10-13 02:50:15 -04:00
Brandon Thomas 9b83caece1 Merge pull request #96 from storytold/echelon-get-media-file-endpoint
v1 of media_file GET endpoint.
2023-10-13 02:40:39 -04:00
Brandon Thomas 138057e105 v1 of media_file GET endpoint.
Media files are used for inference outputs, file uploads, Zero Shot
files, etc. We don't have any of the basic CRUD operations around them
yet, so this is a start.

This endpoint will need more metadata - moderation, file provenance,
file details, etc. But this will do for now.
2023-10-13 02:38:34 -04:00
Brandon Thomas 3e8b6f39fe Merge branch 'master' into feature/enqueue_tts_request 2023-10-12 23:28:08 -04:00
Brandon Thomas 63b4a3180f filter out sadtalker name 2023-10-12 06:22:39 -04:00
Brandon Thomas 6842794af6 another face detection failure 2023-10-12 06:15:43 -04:00
Brandon Thomas a963e5146a more instances of face detection failure 2023-10-12 05:33:56 -04:00
Brandon Thomas eb65ed5fa8 re-codegen db 2023-10-12 03:52:12 -04:00
Brandon Thomas f6989230be write origin_product_category 2023-10-12 03:51:01 -04:00
Brandon Thomas 2d3f29139a re-codegen db 2023-10-12 02:53:48 -04:00
Brandon Thomas a059aa7271 fix lints 2023-10-12 02:08:13 -04:00
Brandon Thomas 8699a9e342 record and report frontend_failure_category 2023-10-12 02:04:29 -04:00
Brandon Thomas 48bf168d99 improve readability 2023-10-12 01:14:03 -04:00
Brandon Thomas f1fd99be15 record frontend_failure_category, emit SadTalker errors 2023-10-12 01:03:36 -04:00
Michael Chung a0b8849806 Trying to build again. 2023-10-12 00:56:50 -04:00
Brandon Thomas 49db299f96 enums for two new columns 2023-10-11 23:09:18 -04:00
Brandon Thomas b1e87b7d90 two migrations (media_files, generic_inference_jobs)
- media_files.origin_product_category
- generic_inference_jobs.frontend_failure_category
2023-10-11 22:38:23 -04:00
Michael Chung bb0a4958ef Need to build and fix the container. 2023-10-11 18:19:40 -04:00
Brandon Thomas 4aacc23101 kill sadtalker jobs 2023-10-11 17:31:41 -04:00
Brandon Thomas 536307c162 analytics queries 2023-10-11 17:11:34 -04:00
Brandon Thomas d5c86d1345 fix breakage due to s3 client upgrade (YOLO) + lint fixes 2023-10-11 16:53:37 -04:00
Brandon Thomas 1900a31541 Merge pull request #66 from storytold/dependabot/cargo/rust-s3-0.33.0
Bump rust-s3 from 0.32.3 to 0.33.0
2023-10-11 16:26:24 -04:00
Brandon Thomas 067538f1c2 Merge pull request #88 from storytold/oct-10-mithoo
use usernames to list datasets/voices & simple handler for listing samples
2023-10-11 16:19:21 -04:00
Michael Chung a256681f6d Merge branch 'master' into feature/enqueue_tts_request 2023-10-11 12:58:57 -04:00
kasisnu 03443be19c inventory list voices with pagination 2023-10-11 16:52:37 +05:30
Michael Chung ec03420efc Fixed issue with typo in job.
Need to fix process job and run it.
2023-10-11 02:51:47 -04:00
Brandon Thomas bfc8171fa7 additional safeguards 2023-10-11 00:02:36 -04:00
Brandon Thomas 248ee45d11 multithreaded 2023-10-10 23:49:43 -04:00
Brandon Thomas 97be5da1b5 Truncate bucket hash for seeded zero shot voice records 2023-10-10 22:06:16 -04:00
Brandon Thomas d26902911f Merge pull request #93 from storytold/feature/fix-database-seed-voice-embeddings
Fixed bucket hash issue
2023-10-10 22:00:27 -04:00
Michael Chung 0560a2d607 Fixed bucket hash issue 2023-10-10 20:34:27 -04:00
Michael Chung 264058ea87 Just a quick commit gotta modify the seeding script to get the bucket hashes for downloading 2023-10-10 20:20:56 -04:00
Brandon Thomas b175cc0e65 cleanup more statuses 2023-10-10 19:24:07 -04:00
Brandon Thomas ae781a3e37 rename to kubectl- to not collide with base tool in tab complete 2023-10-10 19:15:53 -04:00
Brandon Thomas ee00fbe585 cleanup pods with these statuses 2023-10-10 19:12:39 -04:00
Brandon Thomas 82791ec39e delete pods randomly 2023-10-10 18:51:35 -04:00
Brandon Thomas b6bbc76b18 delete batches 2023-10-10 18:24:57 -04:00
Brandon Thomas 1742827ed9 ergonomics 2023-10-10 18:01:06 -04:00
Brandon Thomas 68bc9d0bb0 Merge pull request #89 from storytold/echelon-kubectl-cli
kubectl cli to cleanup dead pods
2023-10-10 17:51:12 -04:00
Brandon Thomas ccc67d43cc kubectl cli to cleanup dead pods 2023-10-10 17:50:05 -04:00
Michael Chung 3845c632b2 Turns out we don't support folder downloads only files. 2023-10-10 17:40:33 -04:00
Michael Chung 22518d9164 Fixed pathing typos 2023-10-10 16:24:16 -04:00
Michael Chung 5dbed7afbb Fixed typo on downloading the vall-e-x model 2023-10-10 16:18:35 -04:00
Michael Chung a485666b1c Test pass!
Payload delivered and picked up.
Need to ensure the job now runs locally.
2023-10-10 16:03:27 -04:00
Michael Chung 54e9b8af70 Fixed routing issue with the job need to move tts text to maybe tts text out of the json. 2023-10-10 15:32:51 -04:00
kasisnu 5a7b0b1bdd simple list dataset samples 2023-10-10 19:15:58 +05:30
kasisnu ee0067161e use usernames instead of user tokens to list voices/datasets 2023-10-10 18:03:22 +05:30
Brandon Thomas a0f464e454 Merge pull request #87 from storytold/echelon-dataset-endpoints
Dataset endpoints, refactoring, cleanup, etc.
2023-10-10 03:22:21 -04:00
Brandon Thomas 332982faa5 Dataset endpoints, refactoring, cleanup, etc. 2023-10-10 03:16:11 -04:00
Brandon Thomas c0e142d668 RMVPE support 2023-10-10 01:18:12 -04:00
Brandon Thomas ca8dce4805 re-codegen db 2023-10-09 23:58:09 -04:00
Brandon Thomas ed1eb9a540 stop dependabot from suggesting /old_code fixes (maybe delete all this?) 2023-10-09 23:30:16 -04:00
Brandon Thomas 0620fa6f98 extra tests for previously broken upgrade 2023-10-09 23:15:09 -04:00
Brandon Thomas 94adc01d62 Merge pull request #86 from storytold/echelon-cleanup-identifiers
Cleanup identifiers (tokens package)
2023-10-09 23:02:15 -04:00
Brandon Thomas 6e76cd3da6 Cleanup identifiers (tokens package) 2023-10-09 23:00:11 -04:00
Brandon Thomas 5a1fd2679c fix for broken dependabot base64 upgrade (semvar violation) 2023-10-09 22:25:38 -04:00
dependabot[bot] f5c3e12f90 Bump rust-s3 from 0.32.3 to 0.33.0
Bumps [rust-s3](https://github.com/durch/rust-s3) from 0.32.3 to 0.33.0.
- [Release notes](https://github.com/durch/rust-s3/releases)
- [Commits](https://github.com/durch/rust-s3/commits/v0.33.0)

---
updated-dependencies:
- dependency-name: rust-s3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-10 02:02:36 +00:00
Brandon Thomas 0a141ea118 Merge pull request #84 from storytold/dependabot/cargo/cidr-utils-0.5.11
Bump cidr-utils from 0.5.10 to 0.5.11
2023-10-09 22:01:02 -04:00
Brandon Thomas dd6c5d1975 Merge pull request #82 from storytold/dependabot/cargo/base64-0.21.0
Bump base64 from 0.13.0 to 0.21.0
2023-10-09 22:00:40 -04:00
Brandon Thomas 91dcd1f876 Merge pull request #83 from storytold/dependabot/cargo/unicode-segmentation-1.10.1
Bump unicode-segmentation from 1.7.1 to 1.10.1
2023-10-09 22:00:08 -04:00
Brandon Thomas 1869ead6ad Merge pull request #85 from storytold/dependabot/cargo/futures-util-0.3.28
Bump futures-util from 0.3.26 to 0.3.28
2023-10-09 21:59:34 -04:00
Brandon Thomas 1c81874b28 fix tests and lints 2023-10-09 21:55:48 -04:00
Brandon Thomas c8b79bfb40 cleanup logic 2023-10-09 21:44:14 -04:00
Brandon Thomas 767d76f831 comments about dev bucket 2023-10-09 21:04:36 -04:00
Brandon Thomas b163791db2 Merge pull request #77 from storytold/feature/enqueue_tts_request
Feature/enqueue tts request
2023-10-09 21:02:26 -04:00
Brandon Thomas d4e8bfb1f8 Merge pull request #79 from storytold/oct-06-mithoo
adds list dataset handler and update/delete voices handler
2023-10-09 20:58:25 -04:00
dependabot[bot] fabc1583ca Bump futures-util from 0.3.26 to 0.3.28
Bumps [futures-util](https://github.com/rust-lang/futures-rs) from 0.3.26 to 0.3.28.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.26...0.3.28)

---
updated-dependencies:
- dependency-name: futures-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-09 23:08:03 +00:00
dependabot[bot] 804ab3e4e8 Bump cidr-utils from 0.5.10 to 0.5.11
Bumps [cidr-utils](https://github.com/magiclen/cidr-utils) from 0.5.10 to 0.5.11.
- [Commits](https://github.com/magiclen/cidr-utils/compare/v0.5.10...v0.5.11)

---
updated-dependencies:
- dependency-name: cidr-utils
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-09 23:07:31 +00:00
dependabot[bot] cd0e104808 Bump unicode-segmentation from 1.7.1 to 1.10.1
Bumps [unicode-segmentation](https://github.com/unicode-rs/unicode-segmentation) from 1.7.1 to 1.10.1.
- [Commits](https://github.com/unicode-rs/unicode-segmentation/compare/1.7.1...v1.10.1)

---
updated-dependencies:
- dependency-name: unicode-segmentation
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-09 23:07:00 +00:00
dependabot[bot] a7d794e29b Bump base64 from 0.13.0 to 0.21.0
Bumps [base64](https://github.com/marshallpierce/rust-base64) from 0.13.0 to 0.21.0.
- [Changelog](https://github.com/marshallpierce/rust-base64/blob/master/RELEASE-NOTES.md)
- [Commits](https://github.com/marshallpierce/rust-base64/compare/v0.13.0...v0.21.0)

---
updated-dependencies:
- dependency-name: base64
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-09 23:05:57 +00:00
kasisnu eed7dc28f8 adds simple voice list endpoint 2023-10-09 18:33:07 +05:30
kasisnu d4c5710513 filter private/hidden datasets, make user token non-optional 2023-10-09 12:26:54 +05:30
Michael Chung d8c4df4c02 Ok fixed the odd linting error. 2023-10-06 18:12:04 -04:00
Michael Chung 13809ad309 Fixed issue 2023-10-06 18:04:46 -04:00
Michael Chung 95888e683d Formatter works now, braces can get properly placed 2023-10-06 18:01:25 -04:00
Michael Chung 3012dea984 process_single_tts_job augmented... 2023-10-06 17:58:07 -04:00
Michael Chung ae899d8aca Fixed most of the job and implemented it.
Need to run the container this might be fun haha ...
2023-10-06 15:21:38 -04:00
Michael Chung dda05ba22c Have to pull master for the lastest seed changes 2023-10-06 13:01:17 -04:00
Brandon Thomas 63795b2cb6 Merge pull request #81 from storytold/echelon-test-weights
Add zero shot weights and upload six test files; add to db seed tool
2023-10-06 12:51:20 -04:00
Brandon Thomas 8aa97a6a4f Add zero shot weights and upload six test files; add to db seed tool 2023-10-06 12:50:02 -04:00
Michael Chung e23369761b Merge branch 'master' into feature/enqueue_tts_request 2023-10-06 11:35:11 -04:00
Brandon Thomas 2b27d6fe41 Merge pull request #80 from storytold/echelon-seed-tool-2
More seed tool things
2023-10-06 11:30:14 -04:00
Michael Chung c6eefc41ec Ok fixed the build now working on job running. 2023-10-06 10:55:51 -04:00
Michael Chung 9e3a3b79f9 job process wip 2023-10-06 09:49:09 -04:00
kasisnu 2aa063c354 some meat on the list datasets handler - filtering logic needs wdork 2023-10-06 18:04:44 +05:30
kasisnu f77d4a636b skip mod token when creating datasets 2023-10-06 16:07:29 +05:30
Brandon Thomas 018b05a3a2 Seed voice conversion models 2023-10-06 02:50:12 -04:00
kasisnu fd3661e25d list/delete voices simple handlers 2023-10-06 12:07:51 +05:30
Brandon Thomas 39de5aba13 More updates to seed tool 2023-10-06 01:30:43 -04:00
Brandon Thomas 6354e7c3b4 Merge pull request #78 from storytold/echelon-db-seeding
Database seed tool
2023-10-06 01:17:59 -04:00
Brandon Thomas eaa9ddd62d seed voice 2023-10-06 00:51:52 -04:00
Michael Chung 195a2eeb9c Outlined the things needed to be done in process_job 2023-10-06 00:49:42 -04:00
Brandon Thomas bef5dce947 seed dataset 2023-10-06 00:36:15 -04:00
Brandon Thomas dd3f9c9d3e move query modules 2023-10-06 00:19:41 -04:00
Brandon Thomas aac31f77ad Database seed tool 2023-10-06 00:09:42 -04:00
Brandon Thomas d07a147db9 Merge pull request #62 from storytold/feat-create-dataset
create zs dataset endpoint - basic impl
2023-10-06 00:03:47 -04:00
Michael Chung ba76acec35 some more fixes to model downloaders 2023-10-05 23:05:27 -04:00
Michael Chung a2c196587f Added Inference Command Stub
Added Create Embedding Command Stub
Need to implement job process:
Download Embedding File aka voice token.
model_downloaders is all good.
validate_job.
2023-10-05 22:29:25 -04:00
Brandon Thomas 8d36d6c709 Add some downloaders for vall-e-x 2023-10-05 21:43:36 -04:00
Michael Chung 4f5f6cfe51 Getting the pieces ready for inference_job 2023-10-05 13:29:51 -04:00
kasisnu 7c59f267fc placeholder sql query to create a voice 2023-10-05 17:41:44 +05:30
kasisnu 23a6daa144 list handler questions 2023-10-05 16:34:36 +05:30
kasisnu a22038ea31 delete datasets & allow mods to undelete 2023-10-05 15:59:56 +05:30
Michael Chung 5de40b2dab Fix a build issues the payload sends exploring the job creation and inference side of it. 2023-10-04 16:30:46 -04:00
kasisnu 484e6788e3 enforce user token check 2023-10-04 19:02:16 +05:30
kasisnu b67cfb5fbe basic update dataset handler & synthetic id tracking 2023-10-04 18:03:13 +05:30
Brandon Thomas d46075a2a3 codegen 2023-10-04 03:58:05 -04:00
Brandon Thomas aa9b834f4b Merge pull request #76 from storytold/echelon-add-media-file-extension
Add media prefix and file extension
2023-10-04 03:50:00 -04:00
Brandon Thomas 2abba4b639 populate prefix and extension 2023-10-04 03:34:43 -04:00
kasisnu c42c091b2d create zs dataset endpoint - basic impl 2023-10-04 12:32:58 +05:30
Brandon Thomas cde8447a9c add table for bucket prefix 2023-10-04 02:33:28 -04:00
Brandon Thomas 4306a4763d Add extension 2023-10-04 02:24:28 -04:00
Brandon Thomas 9701e29b58 Migration to add file extension (eg. ".mp4") 2023-10-04 02:24:28 -04:00
Brandon Thomas 8512846efa Merge pull request #75 from storytold/bt-revert-sqlx-upgrade
Revert "Bump sqlx-core from 0.6.2 to 0.7.2"
2023-10-04 02:23:09 -04:00
Brandon Thomas c7b54e1548 Revert "Bump sqlx-core from 0.6.2 to 0.7.2"
This reverts commit 6b8c1a3106.
2023-10-04 02:15:54 -04:00
Brandon Thomas 8343cf1b65 Merge pull request #70 from storytold/dependabot/cargo/sqlx-core-0.7.2
Bump sqlx-core from 0.6.2 to 0.7.2
2023-10-04 02:04:06 -04:00
Brandon Thomas 4d4b55d39d Merge pull request #68 from storytold/dependabot/cargo/once_cell-1.18.0
Bump once_cell from 1.17.0 to 1.18.0
2023-10-04 02:03:54 -04:00
dependabot[bot] 6b8c1a3106 Bump sqlx-core from 0.6.2 to 0.7.2
Bumps [sqlx-core](https://github.com/launchbadge/sqlx) from 0.6.2 to 0.7.2.
- [Changelog](https://github.com/launchbadge/sqlx/blob/main/CHANGELOG.md)
- [Commits](https://github.com/launchbadge/sqlx/commits)

---
updated-dependencies:
- dependency-name: sqlx-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-04 06:03:43 +00:00
Brandon Thomas 63b3cb8216 Merge pull request #67 from storytold/dependabot/cargo/url-2.4.1
Bump url from 2.3.1 to 2.4.1
2023-10-04 02:03:25 -04:00
Brandon Thomas 3d4522126e Merge pull request #65 from storytold/dependabot/cargo/openssl-0.10.57
Bump openssl from 0.10.42 to 0.10.57
2023-10-04 02:02:33 -04:00
Brandon Thomas 8be1b5afa3 Merge pull request #69 from storytold/dependabot/cargo/actix-rt-2.9.0
Bump actix-rt from 2.7.0 to 2.9.0
2023-10-04 02:02:15 -04:00
dependabot[bot] 11f6995942 Bump actix-rt from 2.7.0 to 2.9.0
Bumps [actix-rt](https://github.com/actix/actix-net) from 2.7.0 to 2.9.0.
- [Release notes](https://github.com/actix/actix-net/releases)
- [Commits](https://github.com/actix/actix-net/compare/rt-v2.7.0...rt-v2.9.0)

---
updated-dependencies:
- dependency-name: actix-rt
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-04 05:56:36 +00:00
dependabot[bot] 589d13fdd1 Bump once_cell from 1.17.0 to 1.18.0
Bumps [once_cell](https://github.com/matklad/once_cell) from 1.17.0 to 1.18.0.
- [Changelog](https://github.com/matklad/once_cell/blob/master/CHANGELOG.md)
- [Commits](https://github.com/matklad/once_cell/compare/v1.17.0...v1.18.0)

---
updated-dependencies:
- dependency-name: once_cell
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-04 05:56:02 +00:00
dependabot[bot] 3f9160701f Bump url from 2.3.1 to 2.4.1
Bumps [url](https://github.com/servo/rust-url) from 2.3.1 to 2.4.1.
- [Release notes](https://github.com/servo/rust-url/releases)
- [Commits](https://github.com/servo/rust-url/compare/v2.3.1...v2.4.1)

---
updated-dependencies:
- dependency-name: url
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-04 05:55:30 +00:00
Brandon Thomas 9e8c27edfd Create dependabot.yml 2023-10-04 01:53:23 -04:00
dependabot[bot] 6540aed9dc Bump openssl from 0.10.42 to 0.10.57
Bumps [openssl](https://github.com/sfackler/rust-openssl) from 0.10.42 to 0.10.57.
- [Release notes](https://github.com/sfackler/rust-openssl/releases)
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.42...openssl-v0.10.57)

---
updated-dependencies:
- dependency-name: openssl
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-04 05:53:08 +00:00
Brandon Thomas 7cd570083c Merge pull request #64 from storytold/bt-misc-fix
fixing a few things
2023-10-04 01:10:15 -04:00
Brandon Thomas 8787e3ef1e tests for lipsync payload 2023-10-04 01:09:40 -04:00
Brandon Thomas 49b25cc79d fix query cache codegen 2023-10-04 01:09:40 -04:00
Brandon Thomas eff73a9cff actually check premium plan 2023-10-04 01:09:40 -04:00
Brandon Thomas d0e3e0f6bb Merge pull request #63 from storytold/bt-twitter-dimensions
SadTalker: Final API shape. Twitter dimensions, non-default options are opt-in, premium watermark
2023-10-04 00:31:00 -04:00
Brandon Thomas e676df0bf4 premium plan features 2023-10-04 00:26:52 -04:00
Brandon Thomas ebed726768 Resize SadTalker to "twitter" dimensions 2023-10-04 00:26:52 -04:00
Michael Chung e0145f0e70 Test this endpoint ensure that the record is created and you can see it grabbed. 2023-10-03 19:09:09 -04:00
Brandon Thomas 2f3037514f takedown requests 2023-10-03 13:38:13 -04:00
Michael Chung f7c636cf58 Added TTS payloads should be able to enter a entry after a migration then follow the event
to the inference dispatch and fill out the code there.
2023-10-02 23:56:52 -04:00
Michael Chung ec4a172929 Adding generic inference args and creating the job soon 2023-10-02 23:08:28 -04:00
Michael Chung 773b96fb35 Stubbing out work in the handler
Adding VallEX as a inference model type
Test pass
2023-10-02 21:45:40 -04:00
Michael Chung 40d0d0d844 Changing up enqueue_infer_tts_handler to allow embedding tokens. 2023-10-02 20:17:36 -04:00
Brandon Thomas dbae9803e2 Merge pull request #61 from storytold/testing-and-images-libs
Libraries for testing and image processing
2023-10-02 16:21:28 -04:00
Brandon Thomas 87093bf291 Libraries for testing and image processing
Just getting started here.
2023-10-02 16:20:07 -04:00
Michael Chung 0b3ea3af2a Working on enqueue_tts_request assuming the prompt is around. 2023-10-02 16:15:25 -04:00
ArEnSc 1a75d5b7b3 Merge pull request #60 from storytold/feature/postman-collections
Postman Collections
2023-10-02 14:58:16 -04:00
Michael Chung fb5dbae029 Added the GPT4Prompt for generating the collections and posted some relevant end points. 2023-10-02 13:41:06 -04:00
Brandon Thomas d2fba4349d fix broken lint 2023-10-01 17:17:43 -04:00
Brandon Thomas b76b4460e3 forgot to codegen after leaderboard query adjustment 2023-10-01 17:10:49 -04:00
Brandon Thomas 5fee53d7c7 Merge pull request #59 from storytold/echelon-sadtalker-options
More options for SadTalker
2023-10-01 17:07:33 -04:00
ArEnSc 4f589cd1b7 Merge pull request #58 from storytold/feature/Zeroshot-inference-job1
Feature/Stubs for Voice Designer?
2023-10-01 16:53:35 -04:00
Michael Chung 5b9f1551ee Put stubs behind feature flag. 2023-10-01 16:51:14 -04:00
Michael Chung e47125f12d Nested the endpoints wrong because to many ))) and got confused. 2023-10-01 15:04:01 -04:00
Michael Chung afa050b45e Testing routes 2023-10-01 13:44:22 -04:00
Brandon Thomas ab6986e4b4 Merge pull request #57 from storytold/echelon-hide-leaderboard
Hide Vegito's test account from TTS leaderboard
2023-10-01 05:45:20 -04:00
Brandon Thomas 53626cb312 More options for SadTalker 2023-10-01 05:07:56 -04:00
Brandon Thomas a8810a2db8 Hide Vegito's account from TTS leaderboard 2023-09-30 11:07:08 -04:00
Michael Chung cb8266d61e Run then test end points for the responses 2023-09-30 01:43:56 -04:00
Michael Chung 056065458f Early stubs 2023-09-30 01:43:25 -04:00
Michael Chung 7cb18d63f2 Initial stubs for the api 2023-09-30 01:27:36 -04:00
Michael Chung 12a119cc1b Routing for the backend start 2023-09-29 20:30:09 -04:00
Brandon Thomas c8d8546c57 Merge pull request #56 from storytold/echelon-zero-shot-tables
Zero shot tables
2023-09-29 00:10:16 -04:00
Brandon Thomas 3265e097c0 Zero shot tables 2023-09-28 23:45:31 -04:00
Brandon Thomas 695d3da34b analytics query 2023-09-28 10:22:38 -04:00
Brandon Thomas 6733a19315 Merge pull request #55 from storytold/echelon-face-detection-early-failure
Do not respawn SadTalker jobs when face detection fails
2023-09-28 10:20:23 -04:00
Brandon Thomas baefb9f7d6 Do not respawn SadTalker jobs when face detection fails
Currently SadTalker jobs will retry on failure, which is great for
worker nodes with transient issues. Unfortunately failure to detect a
face is a common user input error occuring in just around half of all
image uploads. This will permanently tombstone these jobs.

The new failure class can be reused for future animation systems that
rely on face detection.

There is still some minor work to do to surface this error to the
frontend / user in a friendly way.
2023-09-28 10:14:16 -04:00
Brandon Thomas fc47232e6b Update general_setup.md 2023-09-27 17:27:55 -04:00
Brandon Thomas 83dc262249 make lints and tests pass again 2023-09-26 02:13:16 -04:00
Brandon Thomas 1d3885c367 vendor in easyenv.rs (a crate I wrote) 2023-09-26 02:03:25 -04:00
Brandon Thomas 070433b416 Add watermarking capability 2023-09-22 11:49:55 -04:00
Brandon Thomas f15b89cf3d add face animation statistic to queue stats endpoint 2023-09-22 09:19:13 -04:00
Brandon Thomas 699bb6a6a7 Clion auto-optimize imports, remove dead imports, Clippy lint 2023-09-20 01:39:58 -04:00
Brandon Thomas 226f111a00 fix tests, lints 2023-09-20 01:07:26 -04:00
Brandon Thomas b7794ab48f ignore test data 2023-09-20 00:13:06 -04:00
Brandon Thomas 0bd5c9e93b ignore c sources 2023-09-20 00:11:02 -04:00
ArEnSc 5a981f55aa Merge pull request #54 from storytold/feature/General-Setup-Update
Feature/general setup update
2023-09-19 22:33:49 -04:00
michael chung 3e9581a29d Minor update 2023-09-19 22:32:09 -04:00
michael chung ab42870ff1 Updated General Setup! 2023-09-19 22:29:53 -04:00
michael chung 998c8ef49d General Setup Guide Updates! 2023-09-19 22:09:29 -04:00
Brandon Thomas aa8e7597ee get rid of redundancy 2023-09-19 20:26:35 -04:00
Brandon Thomas 725d16bbd9 readme: hosts file, running application 2023-09-19 20:13:22 -04:00
Brandon Thomas f6ee06a72f updated setup README 2023-09-19 20:01:38 -04:00
Brandon Thomas 14d028ea8a docs 2023-09-19 18:34:39 -04:00
Brandon Thomas 699c49c02f cleanup docs 2023-09-19 18:31:00 -04:00
Brandon Thomas b126998ee3 these are probably obsolete 2023-09-19 18:07:30 -04:00
Brandon Thomas 1b43433b72 Documentation updates 2023-09-19 18:06:37 -04:00
Brandon Thomas 1f7dc268a8 SadTalker arguments (wip) 2023-09-19 17:27:34 -04:00
Brandon Thomas dda67adc52 optional alternate checkpoint path arg 2023-09-15 10:07:33 -04:00
Brandon Thomas fa74b9715f logging for job 2023-09-15 09:28:41 -04:00
Brandon Thomas 653a0b26ce sleep(50) - ugh 2023-09-15 08:51:44 -04:00
Brandon Thomas ab8e9b9134 sqlite was failing, emit which is being prepared 2023-09-15 06:36:11 -04:00
Brandon Thomas dac67ada23 codegen db 2023-09-15 06:35:04 -04:00
Brandon Thomas f56530e36b Merge pull request #53 from storytold/bt-sadtalker-backup-2.2
Sad Talker worker, file uploads, etc.
2023-09-15 06:32:45 -04:00
Brandon Thomas 3077359165 logs 2023-09-15 06:29:22 -04:00
Brandon Thomas efdb0377f4 serve bucket paths 2023-09-15 06:15:11 -04:00
Brandon Thomas 4e935a1c2b worker details 2023-09-15 04:43:23 -04:00
Brandon Thomas 063760663f get job working again 2023-09-15 04:14:38 -04:00
Brandon Thomas 176cbcc4be remove directory full path, work on query 2023-09-15 03:33:55 -04:00
Brandon Thomas 359b7a5bd0 migrations, about to insert media file result 2023-09-15 02:19:41 -04:00
Brandon Thomas 9f67a3b82d SadTalker inference works ! 2023-09-14 05:33:08 -04:00
Brandon Thomas eb0e05f61e download image and audio 2023-09-14 04:58:28 -04:00
Brandon Thomas 24f6b3c2f6 upload image route 2023-09-12 20:04:58 -04:00
Brandon Thomas c47bae40d4 download voice conversion result 2023-09-12 20:04:58 -04:00
Brandon Thomas cf2c246bc2 voice_conversion_for_inference 2023-09-12 20:04:58 -04:00
Brandon Thomas 9b89402549 get_voice_conversion_result query 2023-09-12 20:04:58 -04:00
Brandon Thomas f2f2bd465c wip 2023-09-12 20:04:58 -04:00
Brandon Thomas 7e9acc6476 unpack args 2023-09-12 20:04:58 -04:00
Brandon Thomas 7d68347f4f fixed enqueue, fixed downloaders 2023-09-12 20:04:58 -04:00
Brandon Thomas 655f9fad7d downloaders 2023-09-12 20:04:58 -04:00
Brandon Thomas 754581ec70 impl_model_downloader appears to work 2023-09-12 20:04:58 -04:00
Brandon Thomas 80b7352581 async trait/macro starting to work 2023-09-12 20:04:58 -04:00
Brandon Thomas dd7bd71587 model downloader trait wip 2023-09-12 20:04:58 -04:00
Brandon Thomas e41f72305b (from other laptop) - inference args work, inference-job boilerplate 2023-09-12 20:04:58 -04:00
Brandon Thomas fa2a15a4f2 install route 2023-09-12 20:04:58 -04:00
Brandon Thomas eddb71d712 enqueue animation endpoint + more plumbing 2023-09-12 20:04:58 -04:00
Brandon Thomas 71758e6616 upload images (untested) 2023-09-12 20:04:58 -04:00
Brandon Thomas 7afa50ce29 another 101soundboards account 2023-09-12 18:42:38 -04:00
Brandon Thomas 14480e50b4 analytics queries 2023-08-31 22:45:43 -04:00
Brandon Thomas b99e4c5edb more 101soundboards accounts and notes 2023-08-31 22:31:38 -04:00
Brandon Thomas f5b7ad0428 analytics queries 2023-08-30 22:49:55 -04:00
Brandon Thomas ff2713358d imyfone notes 2023-08-28 21:37:28 -04:00
Brandon Thomas 60ab3565bd 101soundboards notes 2023-08-28 21:34:53 -04:00
Brandon Thomas d4ee7a8673 ban some abusers 2023-08-28 21:31:49 -04:00
Brandon Thomas 8e15e1e14c media_files enums 2023-08-23 21:33:06 -04:00
Brandon Thomas a8f0947352 media file token 2023-08-23 21:14:45 -04:00
Brandon Thomas 2600762df2 mysql table: media_files 2023-08-23 21:01:49 -04:00
Brandon Thomas 1100fc1a91 clion/intellij formatting rules 2023-08-23 18:03:56 -04:00
Brandon Thomas a538989c57 UserInfoLite shared response type 2023-08-23 18:03:36 -04:00
Brandon Thomas a4524ee679 execute all lints and tests 2023-08-23 17:13:11 -04:00
Brandon Thomas 1551a014a4 revisit rustfmt with minimal changes to formatting 2023-08-21 00:59:52 -04:00
Brandon Thomas e5afff51a6 Change rustfmt rules 2023-08-21 00:32:17 -04:00
Brandon Thomas 9a7b746460 return statement lint 2023-08-21 00:23:09 -04:00
Brandon Thomas a63b085086 Clippy: fix for newrelic, lint duplicate field name 2023-08-20 21:56:20 -04:00
Brandon Thomas 3b40f005d0 add storyteller.ai hostname 2023-08-20 21:01:57 -04:00
Brandon Thomas afc4fbdcb5 lints 2023-08-20 20:59:22 -04:00
Brandon Thomas 63008a7fe8 analytics query 2023-08-18 09:01:57 -04:00
Brandon Thomas 902c840833 takedown request 2023-08-18 08:49:05 -04:00
Brandon Thomas e8a8c6349f clippy 2023-08-16 16:00:37 -04:00
Brandon Thomas 76a62eaece more lints (add gradually) 2023-08-16 02:57:06 -04:00
Brandon Thomas 226fb93a36 lint progress 2023-08-16 02:28:48 -04:00
Brandon Thomas 1868170c31 more progress on lints 2023-08-16 01:51:30 -04:00
Brandon Thomas 7ecdac5151 Lint script 2023-08-16 01:34:24 -04:00
Brandon Thomas f41833e4f4 cargo cranky: &'static 2023-08-15 23:56:03 -04:00
Brandon Thomas bd9c4d752f move includes to single root dir 2023-08-15 23:42:01 -04:00
Brandon Thomas 7dab1b9ea1 username reservations 2023-08-14 14:33:32 -04:00
Brandon Thomas 512b214fb8 cargo 'cranky' (clippy helper) 2023-08-10 16:50:25 -04:00
Brandon Thomas 21e2eeac68 remove more duplicates 2023-08-10 15:28:43 -04:00
Brandon Thomas ec7a61a08e remove duplicates 2023-08-10 15:00:05 -04:00
Brandon Thomas c195a23425 inventory duplicates 2023-08-10 14:49:03 -04:00
Brandon Thomas 2c61db12d6 takedown requests 2023-08-10 14:36:24 -04:00
Brandon Thomas 8bac7ca332 analytics queries 2023-08-10 14:22:32 -04:00
Brandon Thomas 56fb99aa81 takedown request 2023-08-07 16:28:58 -04:00
Brandon Thomas e87091c5cb re-codegen 2023-07-30 18:13:30 -04:00
Brandon Thomas ffb081777d Enrich stats query with per-queue info 2023-07-30 18:12:45 -04:00
Brandon Thomas e8be6f9775 improved queue length query 2023-07-30 17:26:07 -04:00
Brandon Thomas 2094ab2fe8 query 2023-07-30 16:21:23 -04:00
Brandon Thomas 596434868c takedown requests, duplicates 2023-07-30 00:15:40 -04:00
Brandon Thomas 14c5f02127 takedown requests 2023-07-30 00:04:07 -04:00
Brandon Thomas ffc018ee18 broken clients 2023-07-27 23:54:57 -04:00
Brandon Thomas 0b7f08e838 cache queue stats in Redis 2023-07-27 04:03:07 -04:00
Brandon Thomas 3a8398a94e much better logging for download jobs 2023-07-27 03:10:55 -04:00
Brandon Thomas 35e26e7f72 more queries 2023-07-27 02:48:00 -04:00
Brandon Thomas 3e6b4c43af scope download job 2023-07-27 01:30:33 -04:00
Brandon Thomas e5289809fd more analytics queries 2023-07-26 01:13:38 -04:00
Brandon Thomas b335e1839c analytics queries 2023-07-25 16:59:08 -04:00
Brandon Thomas ce3f83e9af subscriber analytics 2023-07-24 23:46:36 -04:00
Brandon Thomas e324c6ce44 query to restart failed downloads 2023-07-24 20:43:38 -04:00
Brandon Thomas 062a80fafa more analytics, etc. queries 2023-07-24 19:22:47 -04:00
Brandon Thomas 986e8b104a most popular VC models analytics query 2023-07-24 17:15:06 -04:00
Brandon Thomas 1e948a51e9 logging, common media upload query 2023-07-24 02:06:16 -04:00
Brandon Thomas f9b7a0e774 fix bug 2023-07-23 23:41:21 -04:00
Brandon Thomas 4db56881c0 debugging type error 2023-07-23 23:36:57 -04:00
Brandon Thomas c11b2f0a94 better logging 2023-07-23 21:46:26 -04:00
Brandon Thomas 3d9a0cfcc1 scoped job execution 2023-07-23 21:32:39 -04:00
Brandon Thomas b019968ce1 re codegen db 2023-07-23 19:12:59 -04:00
Brandon Thomas 31c88d6d64 Poll voice conversion model info; pull from cache 2023-07-23 19:12:16 -04:00
Brandon Thomas a601998fa5 query for voice conversion model info 2023-07-23 18:08:45 -04:00
Brandon Thomas c1ccfb419a in-memory token info cache 2023-07-23 17:54:41 -04:00
Brandon Thomas d9a1fcf989 types on inference jobs are wrong (gradually fixing) 2023-07-23 17:33:57 -04:00
Brandon Thomas 839b33425a keep alive elapses shouldn't be system failures 2023-07-20 23:58:29 -04:00
Brandon Thomas 8017fef05a rename files across devices 2023-07-20 23:50:19 -04:00
Brandon Thomas 0534db0033 inference-job: more logging, default location for rvc hubert 2023-07-20 23:30:53 -04:00
Brandon Thomas ef53568dcf correct comment 2023-07-20 20:16:58 -04:00
Brandon Thomas 72c5c99a1c no longer log nvidia-smi spam 2023-07-20 20:16:32 -04:00
Brandon Thomas 0b0a9c428c fix python logger issue with rvc-v2 2023-07-20 19:58:46 -04:00
Brandon Thomas a9f0b1d485 fix deletion of directory bug 2023-07-20 18:07:52 -04:00
Brandon Thomas 76dc39df16 Fix list jobs query (now that it isn't statically typed) 2023-07-20 18:04:53 -04:00
Brandon Thomas 79d8af8bf4 re-codegen db 2023-07-20 17:44:03 -04:00
Brandon Thomas b1d69ba9ac no-op comment to trigger build 2023-07-20 15:06:17 -04:00
Brandon Thomas ffcf460291 scope download job type 2023-07-20 14:40:28 -04:00
Brandon Thomas f0a8b6d175 additional logging for download-job 2023-07-20 01:41:59 -04:00
Brandon Thomas e3a5d68fcc download hubert for inference-job 2023-07-20 00:02:41 -04:00
Brandon Thomas 877b95a00c Download pretrained hubert for download-job 2023-07-19 23:36:38 -04:00
Brandon Thomas 20e32ff3e3 begin handling hubert 2023-07-19 22:35:42 -04:00
Brandon Thomas 97a6f6e4ff add health checker to download-job 2023-07-19 19:52:24 -04:00
Brandon Thomas cf27fca799 Merge pull request #52 from storytold/bt-upgrade-actix-4
upgrade to actix 4
2023-07-19 02:53:40 -04:00
Brandon Thomas 5eab05753f fix broken tests 2023-07-19 02:52:11 -04:00
Brandon Thomas 385e1e53c1 update middleware 2023-07-19 02:41:40 -04:00
Brandon Thomas 039e61499f fix routes generics / upgrade generics on routing pieces 2023-07-19 01:57:51 -04:00
Brandon Thomas 9dd91ce7cc only a few compile errors left with storyteller-web 2023-07-19 01:09:10 -04:00
Brandon Thomas a75c1f391a Upgrade actix partially (was on beta version)
Old version was causing conflicts with zip and transitive bzip
dependency, so it's time to upgrade. We need to get to the next version
number soon anyway.
2023-07-19 00:20:49 -04:00
Brandon Thomas d833b3babd Merge pull request #51 from storytold/bt-rvc-v2-support
RVC v2 support
2023-07-18 23:06:49 -04:00
Brandon Thomas 1427e3eecd Handle zip files with .index files 2023-07-18 23:05:46 -04:00
Brandon Thomas 45990f5631 research 2023-07-18 17:57:37 -04:00
Brandon Thomas 5653a918c0 codegen db (was there an sqlite issue?) 2023-07-18 16:53:08 -04:00
Brandon Thomas 8172774a98 Handle RVC models without an index file 2023-07-18 16:50:44 -04:00
Brandon Thomas 6189d6fe9d working rvc(v2), it needs cleanup; also fixed race condition 2023-07-18 02:13:46 -04:00
Brandon Thomas 395940ef34 Progress on rvc inference job (not working yet) 2023-07-18 01:55:39 -04:00
Brandon Thomas 85cfc0cf2e env files 2023-07-18 00:10:57 -04:00
Brandon Thomas 93e066e70b fixing rvc uploads 2023-07-17 17:10:14 -04:00
Brandon Thomas 5cb79a5a33 Begin work on download-job rvc-v2 support 2023-07-17 16:24:35 -04:00
Brandon Thomas 6b06a825f3 Merge pull request #50 from storytold/bt-saj-rvc-integration
Bt saj rvc integration
2023-07-16 19:26:23 -04:00
Brandon Thomas d653260ee5 Change enum variant name 2023-07-16 19:22:00 -04:00
Paul Sajna c8530e186e rvc stubs 2023-07-15 21:56:46 -04:00
Brandon Thomas aee52c04ff Fix failing builds (everything was working before)
Something mysteriously made my machine think we needed nightly.

Begone, nightly.
2023-07-15 21:55:59 -04:00
Brandon Thomas cd91acb4a8 fix compile error 2023-07-15 21:13:37 -04:00
Brandon Thomas d591472478 Merge pull request #49 from storytold/new-queries
new queries
2023-07-14 10:59:11 -04:00
Brandon Thomas c14073f06d new queries 2023-07-14 10:58:34 -04:00
Brandon Thomas edde256ff6 delete more duplicates 2023-06-27 15:33:50 -07:00
Brandon Thomas c6bcd25b19 get rid of takedown request models, duplicate models 2023-06-27 15:20:37 -07:00
Brandon Thomas 82c1563459 comments about users 2023-06-25 21:51:18 -07:00
Brandon Thomas 866ed89d9c refactor disabled endpoint filter 2023-06-25 21:21:53 -07:00
Brandon Thomas ac4ffb4f34 refactor 2023-06-25 20:57:36 -07:00
Brandon Thomas 41fe0866d4 refactor ip filter 2023-06-25 20:42:06 -07:00
Brandon Thomas de3e2e8924 cidr refactor 2023-06-25 20:28:31 -07:00
Brandon Thomas 800c9bd9d5 Add cidr filter 2023-06-25 20:11:59 -07:00
Brandon Thomas 1fe62a2570 Actix CIDR filter 2023-06-25 19:59:01 -07:00
Brandon Thomas f293b56089 Merge pull request #47 from storytold/bt-block-alibaba
block a few Alibaba IPs
2023-06-23 21:23:43 -04:00
Brandon Thomas a0a2d1434f block a few Alibaba IPs 2023-06-23 18:23:03 -07:00
Brandon Thomas 8ba1d9f303 Merge pull request #45 from storytold/bevy-experiments
roko bevy testing
2023-06-20 10:17:23 -04:00
Paul Sajna a11779e3aa roko bevy testing 2023-06-19 11:31:32 -07:00
Brandon Thomas 5c46fd7c60 easier to see logs in k8s 2023-06-17 19:02:28 -07:00
Brandon Thomas 09e26164b8 even beefier build machines 2023-06-17 18:32:58 -07:00
Brandon Thomas 8c24b0c755 log job successes 2023-06-17 18:18:15 -07:00
Brandon Thomas 83ae73d8d0 improperly counting successes 2023-06-17 18:05:34 -07:00
Brandon Thomas 1d0db0eeb9 install nvidia-container packages 2023-06-17 16:12:19 -07:00
Brandon Thomas 04581d06ee better exit status 2023-06-17 14:14:29 -07:00
Brandon Thomas a31ecc01ab configurable health threshold 2023-06-17 11:43:25 -07:00
Brandon Thomas be20e105ea Health check HTTP server runs and shuts down 2023-06-17 11:39:34 -07:00
Brandon Thomas 67864f3db2 Both job and HTTP server (doesn't respond to ctrl-c) 2023-06-17 11:05:27 -07:00
Brandon Thomas 10c277d9cf health check endpoint (not installed) 2023-06-17 07:49:27 -07:00
Brandon Thomas c6e4c2e274 job stats (consecutive success, failure) for inference-job 2023-06-16 21:42:00 -07:00
Brandon Thomas a3815ad64d Merge pull request #43 from storytold/saj-audiowmark
audiowmark wrapper
2023-05-29 23:23:37 -04:00
Paul Sajna 8cd48fcf58 audiowmark wrapper 2023-05-29 20:15:45 -07:00
Brandon Thomas 523c02326b more logging 2023-05-28 22:34:48 -07:00
Brandon Thomas 37eef276a0 more logger methods 2023-05-28 21:20:30 -07:00
Brandon Thomas f5cbedb230 fix logger 2023-05-28 21:01:14 -07:00
Brandon Thomas 6994a9c2ce documentation 2023-05-28 19:07:45 -07:00
Brandon Thomas 213742ff29 override python logger in dockerfile 2023-05-28 19:05:51 -07:00
Brandon Thomas df4f1e6a6c fix log levels 2023-05-28 19:04:09 -07:00
Brandon Thomas 64fa281bc1 parameter for flushing logs 2023-05-28 18:52:01 -07:00
Brandon Thomas bd386aa70b don't need the logger.py in isolation 2023-05-28 18:16:35 -07:00
Brandon Thomas 28875c9272 Add patches to upstream logger 2023-05-28 18:16:11 -07:00
Brandon Thomas a79bfc7a24 add version of logger we're using in production - we'll patch instead 2023-05-28 17:42:32 -07:00
Brandon Thomas ecca8ff17c we'll need to replace python logging in our container for performance 2023-05-28 17:33:04 -07:00
Brandon Thomas a3cabf6779 fix import 2023-05-28 00:53:59 -07:00
Brandon Thomas dd35a7cca9 ignore sensitive env vars 2023-05-28 00:52:05 -07:00
Brandon Thomas f876cac4cf job pause file 2023-05-27 23:23:42 -07:00
Brandon Thomas d2b840cb13 analytics queries 2023-05-27 00:32:09 -07:00
Brandon Thomas 85bac00194 password_reset table 2023-05-23 02:12:58 -07:00
Brandon Thomas 367a516f89 fix option typo 2023-05-23 01:41:01 -07:00
Brandon Thomas 5fe85072a2 pack more in docker container, "hacky fix" flag for so-vits-svc 2023-05-23 00:16:11 -07:00
Brandon Thomas 5867d2356c install vim 2023-05-22 22:21:53 -07:00
Brandon Thomas 275333c1ed netstat in docker image 2023-05-22 17:44:41 -07:00
Brandon Thomas 5ec2cde68f report errors better 2023-05-22 11:15:19 -07:00
Brandon Thomas daf5a63f86 cleanup temp dir 2023-05-22 02:44:34 -07:00
Brandon Thomas 2fe3d5dc99 add less to container 2023-05-22 02:38:20 -07:00
Brandon Thomas 44df952bd1 fix inference job path for VC uploaded audio 2023-05-22 01:51:12 -07:00
Brandon Thomas 5bf98f70d9 rework where temp storage lives: download vs workspace 2023-05-22 00:52:49 -07:00
Brandon Thomas af685b37cf fix keepalive redis in job 2023-05-21 22:11:19 -07:00
Brandon Thomas 0f7ff50cf6 better error logging 2023-05-21 20:01:08 -07:00
Brandon Thomas 1ae8d8d615 Fail jobs with elapsed keepalive 2023-05-21 18:16:44 -07:00
Brandon Thomas 63c0124267 test execution safety 2023-05-21 17:52:53 -07:00
Brandon Thomas 17e8c1942e codegen db 2023-05-21 17:49:58 -07:00
Brandon Thomas cf24a07bba Set keepalive key 2023-05-21 17:48:29 -07:00
Brandon Thomas 9ece30722f Enqueue inferene with keepalive flag 2023-05-21 17:21:17 -07:00
Brandon Thomas 9ab977d016 Add job table keepalive column 2023-05-21 17:04:02 -07:00
Brandon Thomas ebd3f52717 tmux to gpu container 2023-05-19 04:22:53 -07:00
Brandon Thomas 35a75e144a unban IP 2023-05-19 04:08:29 -07:00
Brandon Thomas 4b145a7419 Patch for firefox opus audio uploads failing 2023-05-19 04:06:36 -07:00
Brandon Thomas eb539e9142 query was wrong 2023-05-19 02:08:51 -07:00
Brandon Thomas 37604cdd7b config 2023-05-19 02:48:22 -04:00
Brandon Thomas f724031aa3 config 2023-05-19 02:44:14 -04:00
Brandon Thomas b8b10f6fc1 f0-method and frequency transpose for job 2023-05-18 12:17:08 -07:00
Brandon Thomas bd4bcab2c2 args for pitch/f0 method in http handler 2023-05-18 00:14:42 -07:00
Brandon Thomas caa3e3ae53 clear filesystem when full 2023-05-16 01:13:54 -07:00
Brandon Thomas 7cd8099ab5 variable length tts inference text 2023-05-15 00:47:57 -07:00
Brandon Thomas 6ec39b9c68 loyalty for VC contributors 2023-05-14 21:00:27 -07:00
Brandon Thomas c8b4b7daa0 analytics queries 2023-05-13 09:27:57 -07:00
Brandon Thomas a294549d02 queries 2023-05-09 12:55:07 -04:00
Brandon Thomas 33ff75274f add ripgrep 2023-05-04 06:17:12 -07:00
Brandon Thomas 945e5226c5 add a few tools to the container 2023-05-04 03:47:54 -07:00
Brandon Thomas 85a52cd26e config comments 2023-05-04 03:09:23 -04:00
Brandon Thomas 32ee4209da this configuration works 2023-05-04 03:07:38 -04:00
Brandon Thomas f94cdac47d local dev confi 2023-05-03 23:18:53 -04:00
Brandon Thomas a2ea870ac7 update nvidia driver ??? 2023-05-02 23:01:29 -07:00
Brandon Thomas a2c48d7469 kill subprocess if timeout elapses 2023-05-02 22:19:03 -07:00
Brandon Thomas fe3dd7d66b add routing tags to inference jobs 2023-05-02 21:31:39 -07:00
Brandon Thomas 88fae4ba89 timeout argument 2023-05-02 06:12:49 -07:00
Brandon Thomas 6505e67bf2 analytics 2023-05-02 04:37:21 -07:00
Brandon Thomas 3453fe0e3b add minor logging 2023-05-02 01:18:25 -07:00
Brandon Thomas 8b36d870d1 fix inference job, add env perameter for threshold 2023-05-01 06:52:34 -07:00
Brandon Thomas 9555ac51fe Skip jobs that aren't on filesystem 2023-05-01 06:42:41 -07:00
Brandon Thomas f00b4011b5 record inferecne duration stats to db 2023-05-01 04:17:36 -07:00
Brandon Thomas d1d208d714 add more timing stats to the jobs tables 2023-05-01 03:59:05 -07:00
Brandon Thomas a5ce9a3cc4 analytics 2023-04-30 08:16:27 -07:00
Brandon Thomas 6ad2468e59 analytics queries 2023-04-30 08:09:07 -07:00
Brandon Thomas c59695343f extend media/symphonia to work with webm+opus 2023-04-30 05:03:40 -07:00
Brandon Thomas 52a83609b6 test case for failing web browser uploads 2023-04-30 00:31:03 -07:00
Brandon Thomas f710b68a3e Fix broken tests, add testing script 2023-04-29 23:56:48 -07:00
Brandon Thomas 3d63e34ca1 analytics queries 2023-04-29 23:36:02 -07:00
Brandon Thomas 4a1f1441bf split analytics and operational queries 2023-04-29 06:08:34 -07:00
Brandon Thomas ee90f03436 add extra inference job stats 2023-04-29 05:11:57 -07:00
Brandon Thomas 1858aea619 new job queue stats endpoint 2023-04-29 04:58:51 -07:00
Brandon Thomas 592ba627be documentation 2023-04-29 03:53:31 -07:00
Brandon Thomas f754c6e41f add execution time to job queries 2023-04-29 03:10:31 -07:00
Brandon Thomas 54af3d301c Add execution millis columns to jobs tables 2023-04-29 02:41:49 -07:00
Brandon Thomas 22eeacf355 stricter compiler flags 2023-04-29 02:30:41 -07:00
Brandon Thomas 630aa497f3 note 2023-04-29 02:28:32 -07:00
Brandon Thomas 6e9c05c596 bootstrap / env config improved, on-prem, etc. 2023-04-29 02:26:13 -07:00
Brandon Thomas 3f781ad98f clean up worker hostname / cluster name in jobs 2023-04-29 02:16:17 -07:00
Brandon Thomas 5d038fdf8f codegen db 2023-04-29 01:50:14 -07:00
Brandon Thomas a09acf7c53 add extra metadata to inference and download jobs 2023-04-29 01:49:25 -07:00
Brandon Thomas 3ba64618c3 add tracking columns to generic_inference_job too 2023-04-29 00:17:44 -07:00
Brandon Thomas 73e583c7ed Add extra metadata tracking to generic download jobs table 2023-04-29 00:08:54 -07:00
Brandon Thomas 1d7a54f640 python for docker image 2023-04-28 16:09:38 -07:00
Brandon Thomas 552fae54a7 fix 2023-04-28 16:02:04 -07:00
Brandon Thomas 4d2ae85fd9 send hubert path for docker 2023-04-28 16:01:18 -07:00
Brandon Thomas 76775dec60 hubert path config 2023-04-28 15:54:53 -07:00
Brandon Thomas 22bc8d54a0 organize settings 2023-04-28 18:46:18 -04:00
Brandon Thomas 878bff867a fix dev env vars 2023-04-28 02:01:11 -04:00
Brandon Thomas 05d5bfc1a7 rename 2023-04-27 23:00:16 -07:00
Brandon Thomas 3acdd0b5e2 rebase fix 2023-04-28 01:47:40 -04:00
Brandon Thomas 1a7a74ee8a so-vits-svc auto_predict_f0 default to false, add option 2023-04-27 22:45:28 -07:00
Brandon Thomas 820f4ebc32 fix firefox/opus again 2023-04-27 15:54:13 -07:00
Brandon Thomas 423fb369db add audio/opus 2023-04-27 08:15:46 -07:00
Brandon Thomas 2a58079289 copy all env vars to child process 2023-04-27 07:19:46 -07:00
Brandon Thomas b2df674178 report mimetype errors 2023-04-27 02:00:31 -07:00
Brandon Thomas 1fd33e76b4 update base image 2023-04-27 01:02:23 -07:00
Brandon Thomas 824683b974 fixup dockerfile 2023-04-27 00:50:45 -07:00
Brandon Thomas 4bed11d21d change name again 2023-04-27 00:12:48 -07:00
Brandon Thomas 13bdcbdda6 fix names of actions 2023-04-27 00:11:40 -07:00
Brandon Thomas f49c724303 GPU + CPU dockerfiles 2023-04-27 00:09:31 -07:00
Brandon Thomas a9502c183b flexible config path for inference job 2023-04-26 10:17:49 -07:00
Brandon Thomas b469a237ce temporarily add nvidia/sound packages to rust monorepo images 2023-04-26 09:14:17 -07:00
Brandon Thomas 0df93c48c3 configs for download job 2023-04-26 07:48:31 -07:00
Brandon Thomas 070c192633 set config and test wav upfront and at runtime 2023-04-26 07:43:59 -07:00
Brandon Thomas 75a68c7e0f install python 2023-04-26 05:45:28 -07:00
Brandon Thomas b2db079cf5 env vars for docker 2023-04-26 04:46:40 -07:00
Brandon Thomas 6658281a1c try more env vars for caching 2023-04-26 04:38:27 -07:00
Brandon Thomas 8cb04f1dcb huggingface+nltk caches 2023-04-26 04:25:43 -07:00
Brandon Thomas 58f6ee68df more flexible command specification 2023-04-26 04:11:06 -07:00
Brandon Thomas d0cef7bec9 hack 2023-04-26 03:30:38 -07:00
Brandon Thomas 8eed406fbd inference-job hack (see if we can run without 'svc' command) 2023-04-26 01:31:02 -07:00
Brandon Thomas 44586c4cee copy the correct env var files 2023-04-25 20:56:18 -07:00
Brandon Thomas 02f5aacb8e more robust configuration of download-job 2023-04-25 20:55:18 -07:00
Brandon Thomas 001ff86ed3 robust configuration for download-job 2023-04-25 20:51:51 -07:00
Brandon Thomas 94b406eca2 much more robust app initialization 2023-04-25 20:44:59 -07:00
Brandon Thomas f8bdea1b3b build error fix 2023-04-25 17:20:21 -07:00
Brandon Thomas 8a37a7240c more DDoS IPs 2023-04-25 17:16:29 -07:00
Brandon Thomas a4c1abfe9c codegen 2023-04-25 06:07:01 -07:00
Brandon Thomas 6bb7a18676 report model title 2023-04-25 04:13:28 -07:00
Brandon Thomas a8173226ea report bucket hash in results 2023-04-25 03:00:31 -07:00
Brandon Thomas 692c3f64b6 two different firehose notifications 2023-04-25 01:33:47 -07:00
Brandon Thomas 4842b9bbc1 local dev config changes 2023-04-25 04:28:00 -04:00
Brandon Thomas a507f8bc38 nope, didn't work 2023-04-25 01:27:28 -07:00
Brandon Thomas 24f2c07199 try to fix duration bug 2023-04-25 01:25:13 -07:00
Brandon Thomas e871dde078 add upload source 2023-04-25 01:09:24 -07:00
Brandon Thomas 47ff379018 timeout 2023-04-24 02:53:59 -07:00
Brandon Thomas cdb0f37889 downgrode symphonia off-master branch to support opus for browsers 2023-04-24 02:32:13 -07:00
Brandon Thomas 6d7c3c6e5f maybe build with correct codecs? 2023-04-24 01:46:52 -07:00
Brandon Thomas 7b72d51bd3 debug logging 2023-04-24 01:11:37 -07:00
Brandon Thomas 11a9e1249c remove inference args (for now) 2023-04-23 23:29:09 -07:00
Brandon Thomas f3a6ddb70a premium priority levels 2023-04-23 23:05:24 -07:00
Brandon Thomas d2aa07228b simplify upload endpoint 2023-04-23 22:30:13 -07:00
Brandon Thomas a2c3668beb upload audio endpoint 2023-04-23 22:25:46 -07:00
Brandon Thomas 15d66a4530 propagate media input token to inference result 2023-04-23 20:48:09 -07:00
Brandon Thomas 75523811e4 ops query 2023-04-23 13:59:01 -07:00
Brandon Thomas 4672102da4 code changes stemming from schema changes 2023-04-23 05:03:37 -07:00
Brandon Thomas ca59189dd9 simplify media_uploads schema 2023-04-23 04:31:00 -07:00
Brandon Thomas 3564c1b459 more schema mods 2023-04-23 04:13:50 -07:00
Brandon Thomas 78263e3c49 media token type 2023-04-23 03:58:16 -07:00
Brandon Thomas e36fb66e05 migrate voice_conversion_results 2023-04-23 03:24:05 -07:00
Brandon Thomas 1540d87018 cleanup 2023-04-23 02:12:46 -07:00
Brandon Thomas 61f0869359 calculate result metadata 2023-04-23 02:02:49 -07:00
Brandon Thomas d23c7abfeb remove deprecated crate -> move hashing + mimetype functions out 2023-04-23 01:31:58 -07:00
Brandon Thomas 2d59891dee organize "file"-related/adjacent crates together 2023-04-23 00:27:09 -07:00
Brandon Thomas 2f86bc75ac crate to handle just mimetype ops 2023-04-23 00:08:59 -07:00
Brandon Thomas 8c5fb0bee2 badge granter for voice conversion models 2023-04-22 06:22:06 -07:00
Brandon Thomas b9f0d7749d fix transaction 2023-04-22 05:36:22 -07:00
Brandon Thomas b2caa3758a fix synthetic id 2023-04-22 05:22:06 -07:00
Brandon Thomas de656d4d74 fix 2023-04-22 04:47:09 -07:00
Brandon Thomas c803232a52 creator synthetic id 2023-04-22 04:44:40 -07:00
Brandon Thomas cd9b0080dd fix result upload directory 2023-04-22 04:04:15 -07:00
Brandon Thomas 6885eb5fc9 temporarily don't get file metadata 2023-04-22 03:55:25 -07:00
Brandon Thomas 100ad0da35 use public bucket client 2023-04-22 03:48:52 -07:00
Brandon Thomas 7010d56bc3 error handling json hydration 2023-04-22 03:44:10 -07:00
Brandon Thomas b34371eef0 try to only parse payload if not empty string 2023-04-22 03:42:29 -07:00
Brandon Thomas e6542438b5 create model storage directory 2023-04-22 03:29:26 -07:00
Brandon Thomas 287e3e5f0c inference for local dev 2023-04-22 02:17:58 -07:00
Brandon Thomas 8fcb908af9 code compiles 2023-04-22 02:14:44 -07:00
Brandon Thomas 56e84f434f forgot schema migrations 2023-04-22 02:05:44 -07:00
Brandon Thomas 925f2d78ae more sane schema for voice conversion results (bucket storage) 2023-04-22 02:04:44 -07:00
Brandon Thomas 90219594bb insert result record 2023-04-22 01:43:24 -07:00
Brandon Thomas 08e8560499 voice conversion result upload (WIP) 2023-04-21 23:27:20 -07:00
Brandon Thomas 9e38b9a2fc progress on so-vits-svc inference 2023-04-21 23:12:24 -07:00
Brandon Thomas e9a6320eab so-vits-svc inference (wip) 2023-04-21 21:51:37 -07:00
Brandon Thomas da05885d7d don't upload duplicates 2023-04-21 05:54:10 -07:00
Brandon Thomas ba9f716ff8 encode fewer bytes in inference jobs 2023-04-21 02:24:23 -07:00
Brandon Thomas 2633c5f0ef clean up tokens in vc inference 2023-04-21 02:05:14 -07:00
Brandon Thomas da805b4f1d clean upload hashing, better error messages 2023-04-21 00:22:58 -07:00
Brandon Thomas 9eb75c7eba list media uploads by session 2023-04-20 01:40:36 -07:00
Brandon Thomas 75607b3c12 tests, aspath 2023-04-20 00:27:37 -07:00
Brandon Thomas ce69b1b055 filesys crate cleanup 2023-04-20 00:18:29 -07:00
Brandon Thomas 9ee7fdbac5 move endpoint 2023-04-19 01:18:07 -07:00
Brandon Thomas 67e3ecebc1 Voice conversion model list endpoint 2023-04-19 00:43:27 -07:00
Brandon Thomas 52db0b7796 python3.6 2023-04-18 15:46:08 -07:00
Brandon Thomas 15fa5a2bee update image 2023-04-18 15:44:58 -07:00
Brandon Thomas 32babc99f0 update image 2023-04-18 12:47:58 -07:00
Brandon Thomas bdac796e51 update tt2 legacy inference to support docker, etc, unfront config 2023-04-18 12:37:30 -07:00
Brandon Thomas 18c50af218 Add "Deepfake CNN" level 2023-04-16 02:54:57 -07:00
Brandon Thomas 62cbde94bc anderson cooper voice config 2023-04-15 23:43:54 -07:00
Brandon Thomas b2f9b44e96 uncommitted changes 2023-04-15 23:36:26 -07:00
Brandon Thomas 6a48a5372c fix arg 2023-04-13 16:58:26 -07:00
Brandon Thomas 1b0368664a update image 2023-04-13 19:53:37 -04:00
Brandon Thomas 6a83524fd9 switch from 'onnx' to 'infer' for checking model integrity 2023-04-13 16:48:14 -07:00
Brandon Thomas 233247f3c0 config path 2023-04-13 15:59:16 -07:00
Brandon Thomas 60045a01d0 fix command 2023-04-13 13:33:57 -07:00
Brandon Thomas dc5dfd9831 update docker image 2023-04-13 13:24:07 -07:00
Brandon Thomas 7b36fc0b98 Update model check command (so-vits-svc), upgrade easyenv 2023-04-13 12:52:18 -07:00
Brandon Thomas 92e1d10809 wip so-vits-svc 2023-04-12 02:53:57 -07:00
Brandon Thomas 4a486cedd2 add so-vits-svc download type 2023-04-10 01:39:54 -07:00
Brandon Thomas 004cde84a7 move enum 2023-04-09 23:03:15 -07:00
Brandon Thomas 61b74500d8 codegen, a few enums 2023-04-09 22:55:21 -07:00
Brandon Thomas 8285826ed0 move where config lives 2023-04-09 20:16:13 -07:00
Brandon Thomas 03d0110ee6 ml docker image 2023-04-09 23:02:57 -04:00
Brandon Thomas 34517fbaff fix build errors 2023-04-09 19:18:07 -07:00
Brandon Thomas 839f7885fb try another path 2023-04-09 02:58:23 -07:00
Brandon Thomas cee3ffb217 fix docker env vars 2023-04-09 02:29:22 -07:00
Brandon Thomas 90198252b8 nltk env var 2023-04-09 02:24:41 -07:00
Brandon Thomas 165130321f try setting cache dir with docker now 2023-04-09 02:10:34 -07:00
Brandon Thomas 061c2c7b07 try to move cache dir again 2023-04-09 01:46:37 -07:00
Brandon Thomas 413960b6cf actually pass env to popen 2023-04-09 01:37:33 -07:00
Brandon Thomas cc4b7deaa9 huggingface cache dir 2023-04-09 01:27:50 -07:00
Brandon Thomas 8229a3cfb3 record entity token/type after job completes 2023-04-08 22:59:16 -07:00
Brandon Thomas b461c7e8e7 make field optional 2023-04-08 21:03:07 -07:00
Brandon Thomas c58f23c117 fixup inference-job 2023-04-08 20:52:51 -07:00
Brandon Thomas 048cc26b6b fixup storyteller-web 2023-04-08 20:50:22 -07:00
Brandon Thomas 9b5508d8c0 fixup mysql queries 2023-04-08 20:41:10 -07:00
Brandon Thomas a81428913d migrate generic_inference_jobs to include better indices/foreign keys 2023-04-08 19:54:58 -07:00
Brandon Thomas 756c8e09ae inference status endpoints 2023-04-08 18:49:59 -07:00
Brandon Thomas 5b97360724 update upload routes 2023-04-08 01:09:22 -07:00
Brandon Thomas 79ad78bdde header to route TT2 requests to new worker 2023-04-06 22:00:44 -07:00
Brandon Thomas 311299105b updated docker image 2023-04-07 00:48:24 -04:00
Brandon Thomas 9dad3a153c ml repo update 2023-04-06 22:50:21 -04:00
Brandon Thomas 93157b50c8 vits inference command roughly done, need to test 2023-04-06 18:58:07 -07:00
Brandon Thomas 47fbc1704d analytics 2023-04-06 16:48:31 -07:00
Brandon Thomas efba106d3c analytics query 2023-04-06 16:26:06 -07:00
Brandon Thomas e340eee250 progress on VITS (WIP) 2023-04-06 16:02:01 -07:00
Brandon Thomas 73be1bbf05 git rid of dated enum, start work on VITS inference 2023-04-06 14:35:29 -07:00
Brandon Thomas 81306d1a56 (untested) route VITS tts to generic job type 2023-04-05 01:48:50 -07:00
Brandon Thomas 8e341f7a83 strongly typed tts model type 2023-04-05 01:21:31 -07:00
Brandon Thomas 1978e5e653 db index on tts_models.tts_model_type 2023-04-05 00:53:52 -07:00
Brandon Thomas 8eaaad9b55 fix path error 2023-04-04 15:01:04 -07:00
Brandon Thomas 082c284add debugging 2023-04-04 14:47:15 -07:00
Brandon Thomas a83e5ff224 logging 2023-04-04 14:25:50 -07:00
Brandon Thomas abaaaf2fdb dev 2023-04-04 14:12:33 -07:00
Brandon Thomas 3409689566 fix path handling, introduce another (smaller scope) filesystem crate 2023-04-04 13:59:21 -07:00
Brandon Thomas 84c0e42964 fmt 2023-04-04 12:53:09 -07:00
Brandon Thomas b848c2b549 update docker image for appropriate cuda version 2023-04-04 15:50:06 -04:00
Brandon Thomas 85abbd8587 set python intepreter, fix path 2023-04-04 03:14:40 -07:00
Brandon Thomas b844191db7 downloader image 2023-04-04 06:08:19 -04:00
Brandon Thomas 0267a4799d fix a few errors with paths and quoting 2023-04-04 03:07:54 -07:00
Brandon Thomas c50060b161 no vits download venv 2023-04-04 02:57:39 -07:00
Brandon Thomas a508a843bd root dir 2023-04-04 02:56:25 -07:00
Brandon Thomas d0bad0c8fb docker image for testing 2023-04-04 05:50:48 -04:00
Brandon Thomas d2c99a7bad configure download-job for VITS (wip) 2023-04-04 00:24:28 -07:00
Brandon Thomas 681d923ae0 Add 'vits' enum to tts model tables 2023-04-04 00:11:48 -07:00
Brandon Thomas 9e563a0640 VITS download WIP (nearly done) 2023-04-03 23:41:18 -07:00
Brandon Thomas db30096cb9 rename module in inference-job 2023-04-03 21:43:42 -07:00
Brandon Thomas 76f9f5a850 Refactor download job, begin to work on VITS downloading 2023-04-03 21:37:07 -07:00
Brandon Thomas 3a0eafee11 report back on how to handle the upload 2023-04-02 21:34:38 -07:00
Brandon Thomas 9fbecd5568 enqueue vits uploads (in theory) 2023-04-02 21:21:16 -07:00
Brandon Thomas b3dedfc5a8 WIP VITS uploads 2023-04-02 21:05:05 -07:00
Brandon Thomas 8ded313e7b configure storyteller-web with more db (why so slow in dev?!) 2023-04-02 20:23:12 -07:00
Brandon Thomas e305928b45 flexible docker image sha 2023-04-02 20:01:45 -07:00
Brandon Thomas db48ee0fd8 mac frontend cors 2023-04-01 05:40:25 -04:00
Brandon Thomas 5beedcb5e3 add one color 2023-03-25 23:12:14 -04:00
Brandon Thomas e43feeb700 add random avatar/color to several endpoints 2023-03-25 19:54:12 -04:00
Brandon Thomas 38dc835ff4 add to event feed 2023-03-25 19:33:59 -04:00
Brandon Thomas 62b19b2b0e functions to generate random avatar + color 2023-03-25 19:04:37 -04:00
Brandon Thomas b7b92f4419 reduce user tokens to a single list 2023-03-23 02:49:33 -04:00
Brandon Thomas 7ee7ff3875 split ipv4/ipv6 files 2023-03-23 02:44:28 -04:00
Brandon Thomas 29237d3ead user tokens 2023-03-23 02:42:05 -04:00
Brandon Thomas 5afbfc0ec4 change troll sequences 2023-03-23 02:32:05 -04:00
Brandon Thomas 6e5a2d1789 more accounts 2023-03-23 02:13:07 -04:00
Brandon Thomas 13281ea3b1 more accounts 2023-03-23 02:10:36 -04:00
Brandon Thomas 98f80a68de documentation on removed ipv6 bans (in cloudflare, not our code) 2023-03-23 01:55:34 -04:00
Brandon Thomas 075fcfb81e unblock ipv6 2023-03-23 01:42:27 -04:00
Brandon Thomas a8c45cfac2 more accounts 2023-03-23 01:40:56 -04:00
Brandon Thomas f0a4f0a4f7 more ips / accounts 2023-03-23 01:09:24 -04:00
Brandon Thomas 3b78853d7c new user tokens and ip addresses 2023-03-23 01:03:58 -04:00
Brandon Thomas 98b6bb34a7 lighten up on the troll text 2023-03-23 01:02:18 -04:00
Brandon Thomas 4d759719f6 more IPs and user tokens 2023-03-23 00:52:41 -04:00
Brandon Thomas ac28ff8a39 start blocking 101soundboards IPs too 2023-03-23 00:50:03 -04:00
Brandon Thomas 43a33a00ee gitignore 2023-03-23 00:43:27 -04:00
Brandon Thomas 8bbc490b61 ignore vim temp files 2023-03-23 00:43:01 -04:00
Brandon Thomas 168a476b72 user token + ip address troll bans 2023-03-23 00:28:00 -04:00
Brandon Thomas 2cebfbb3fc more 101soundboards user tokens 2023-03-23 00:12:44 -04:00
Brandon Thomas d57e070c8c dedup 2023-03-22 23:58:06 -04:00
Brandon Thomas bde6b4d562 more user tokens 2023-03-22 23:56:12 -04:00
Brandon Thomas 9cde097d38 more stupid accounts 2023-03-22 23:53:13 -04:00
Brandon Thomas 1d7d1ba194 more 101soundboards user tokens 2023-03-22 23:50:36 -04:00
Brandon Thomas 632cf5a710 more 101soundboards user tokens 2023-03-22 23:40:19 -04:00
Brandon Thomas c2e287f6f4 more damned accounts 2023-03-22 22:55:26 -04:00
Brandon Thomas 844799e30e more 101soundboards accounts 2023-03-22 22:49:38 -04:00
Brandon Thomas c1bd8ed611 actually fix builds 2023-03-22 19:57:04 -04:00
Brandon Thomas 1466bca4d7 fix build 2023-03-22 18:32:36 -04:00
Brandon Thomas 12fdf24028 temp disable build 2023-03-22 18:28:24 -04:00
Brandon Thomas cefb770340 codegen db 2023-03-22 16:49:24 -04:00
Brandon Thomas e971ea98dc fix troll bans 2023-03-22 16:47:10 -04:00
Brandon Thomas 9ab8b366e9 ban 101 soundboards 2023-03-22 16:24:23 -04:00
Brandon Thomas 96563fa345 add a means to ban user tokens (or disable the service in weird ways) 2023-03-22 16:05:09 -04:00
Brandon Thomas 67ab94664c working locally 2023-03-22 15:34:02 -04:00
Brandon Thomas 99f1226115 I have to run this under Docker locally since it's ancient 2023-03-21 05:35:08 -04:00
Brandon Thomas 9c45a17b8d new inference subprocess command 2023-03-21 05:18:07 -04:00
Brandon Thomas 2cf5a6f942 TTS inference almost working on generic-inference-job 2023-03-21 02:01:13 -04:00
Brandon Thomas 071928d7bf port more TT2 logic 2023-03-21 00:49:21 -04:00
Brandon Thomas b8442b54ee cleanup 2023-03-21 00:18:39 -04:00
Brandon Thomas 530d891ce9 about to bolt on TT2 2023-03-21 00:11:42 -04:00
Brandon Thomas 972f119468 query tts model 2023-03-20 23:57:44 -04:00
Brandon Thomas 9004432620 generic inference jobs can be listed (hacky fix) 2023-03-20 23:42:23 -04:00
Brandon Thomas 81a3bc270b fix generic job list query 2023-03-20 23:11:38 -04:00
Brandon Thomas 84fe5a5762 enqueue generic inference jobs for tt2 2023-03-20 22:28:59 -04:00
Brandon Thomas a02934ca4e Add routing column to inference jobs (wip) 2023-03-20 21:58:08 -04:00
Brandon Thomas 4ddcd43e33 remove a lot of garbage from inference-job 2023-03-20 20:04:49 -04:00
Brandon Thomas 37be0174af put inference job back into "working"(?) order 2023-03-20 19:29:06 -04:00
Brandon Thomas f2e314d168 make sure this gets put in the image 2023-03-20 19:23:54 -04:00
Brandon Thomas 3bd216f00d rename crate, fix path handling, move some env vars 2023-03-20 19:21:58 -04:00
Brandon Thomas dc5885114d env internal crate - search multiple directories for env files 2023-03-20 18:59:43 -04:00
Brandon Thomas 47873497b8 comment APIs needed disambiguation 2023-03-18 18:18:45 -04:00
Brandon Thomas 554766bd2a Don't load IP ban sets that are empty 2023-03-18 13:25:14 -04:00
Brandon Thomas 86382bf219 rename files for better sorting 2023-03-18 13:13:54 -04:00
Brandon Thomas 59b1e28a14 unban IP 2023-03-18 13:12:52 -04:00
Brandon Thomas 3f88a741c9 private model logging + fix(?) 2023-03-18 13:06:19 -04:00
Brandon Thomas 2efcba5da6 fix broken path 2023-03-18 13:00:19 -04:00
Brandon Thomas b4718a2f13 block broken python script IP 104.251.211.22 2023-03-18 12:59:19 -04:00
Brandon Thomas efbb0000f3 fix list comment route 2023-03-18 07:02:50 -04:00
Brandon Thomas 0280e6b706 let's not do this table just yet 2023-03-18 05:37:14 -04:00
Brandon Thomas 79d568ee14 codegen db 2023-03-18 04:51:35 -04:00
Brandon Thomas 85630390a0 route bindings, list endpoint 2023-03-18 04:33:53 -04:00
Brandon Thomas 215b727bc1 create comment, delete comment handlers (not tested) 2023-03-18 03:54:30 -04:00
Brandon Thomas e29c0b4c68 edit comment query 2023-03-18 02:13:46 -04:00
Brandon Thomas c81e6af507 fix codegen script 2023-03-18 01:35:40 -04:00
Brandon Thomas 98d30917e5 rename crate 'database_queries' -> 'mysql_queries' because sqlite 2023-03-18 01:19:15 -04:00
Brandon Thomas e62e409857 refactor package directory structure 2023-03-18 01:11:10 -04:00
Brandon Thomas 417137a9a8 deprecate some crates 2023-03-18 01:07:01 -04:00
Brandon Thomas 0da1994f0c 101soundboards user tokens 2023-03-18 00:45:33 -04:00
Brandon Thomas 36d016c3c7 todo 2023-03-17 09:34:58 -04:00
Brandon Thomas b22e978e54 cleanup tts authorization logic 2023-03-17 08:52:04 -04:00
Brandon Thomas c387f47c97 (untested) disallow use of private models unless owner 2023-03-17 08:34:15 -04:00
Brandon Thomas 1a09676327 codegen db 2023-03-17 07:57:50 -04:00
Brandon Thomas e516f85e5f filter out models that are private/hidden 2023-03-17 07:54:57 -04:00
Brandon Thomas e16b86d36e analytics query for non-public tts models 2023-03-17 06:50:06 -04:00
Brandon Thomas 003a86cd31 delete comments 2023-03-17 06:42:04 -04:00
Brandon Thomas ebf48e20be list comments endpoint 2023-03-16 12:21:28 -04:00
Brandon Thomas df2444ddc0 insert comment 2023-03-16 11:09:26 -04:00
Brandon Thomas 6b6a2ceeba codegen 2023-03-16 10:42:46 -04:00
Brandon Thomas 80da0d9649 Add tts result audio path to result endpoint 2023-03-16 10:31:28 -04:00
Brandon Thomas b8fd0486c7 Untested query for inserting audit log items 2023-03-16 10:25:47 -04:00
Brandon Thomas 12ffb2ded1 new token types: comments, audit logs 2023-03-16 09:36:13 -04:00
Brandon Thomas f810256b9c new table enums 2023-03-16 09:28:49 -04:00
Brandon Thomas 461030b681 new tables (WIP) for comments + voice survey 2023-03-16 09:03:56 -04:00
Brandon Thomas a33ff3f060 20 trending english voices 2023-03-16 09:02:43 -04:00
Brandon Thomas 98736324dc 25 trending english voices 2023-03-16 09:01:57 -04:00
Brandon Thomas 89a6f36f1a gitignore for windows 2023-03-13 20:33:31 -04:00
Brandon Thomas ac5bcbdd16 aichatbot: handler for current level 2023-03-13 18:27:25 -04:00
Brandon Thomas 7566c0d71c use strum and default for more maintainable options 2023-03-13 18:20:58 -04:00
Brandon Thomas 0ca007b6e7 add level option for AiChatbotSidecar 2023-03-13 18:09:28 -04:00
Brandon Thomas cbe07e2b3e move test function out of aichatbot-sidecar 2023-03-13 17:50:04 -04:00
Brandon Thomas 495c01c38c Merge pull request #40 from storytold/bt-cache-session
cache sessions + purge cache on billing, edit profile, etc.
2023-03-12 05:19:28 -04:00
Brandon Thomas ff22319c77 purge session cache with billing endpoints 2023-03-12 05:17:37 -04:00
Brandon Thomas 16f2d5557b clear session cache when user is edited 2023-03-12 04:49:59 -04:00
Brandon Thomas e5cdb84c52 correct cache key 2023-03-12 04:34:50 -04:00
Brandon Thomas 8079be9f7e progress with generics 2023-03-12 04:25:44 -04:00
Brandon Thomas 2821240cc0 generic over executor types 2023-03-12 04:12:22 -04:00
Brandon Thomas ae0522419a this *should* work - need to work on non-pooled version 2023-03-12 03:11:33 -04:00
Brandon Thomas 46bb4274ca work in progress session caching (redis) 2023-03-12 03:00:47 -04:00
Brandon Thomas f2b6dc4349 Merge pull request #39 from storytold/bt-redis-cache-endpoint
Bt redis cache endpoint
2023-03-12 01:25:31 -05:00
Brandon Thomas a395c04265 Delete cache when tts model is edited 2023-03-12 01:24:23 -05:00
Brandon Thomas d3a4613cc9 cleanup closures, fail open to db 2023-03-12 00:04:25 -05:00
Brandon Thomas bdca25cf4f cache works! 2023-03-11 23:58:14 -05:00
Brandon Thomas 06a053b6d9 this compiles too 2023-03-11 23:43:39 -05:00
Brandon Thomas 4104ef0129 this compiles too 2023-03-11 23:33:29 -05:00
Brandon Thomas 0f076cbacd work in progress redis caching (this compiles) 2023-03-11 23:21:39 -05:00
Brandon Thomas 817b2c01df new redis ttl cache crate (untested) 2023-03-11 22:53:01 -05:00
Brandon Thomas c06c47f02e Merge pull request #38 from storytold/bt-fix
Bt fix
2023-03-11 21:57:42 -05:00
Brandon Thomas 23b0dafd6b fix compile errors 2023-03-11 21:57:13 -05:00
Brandon Thomas 91e83c8b90 notes 2023-03-11 21:57:13 -05:00
Brandon Thomas 4a32ced9cd Merge pull request #37 from storytold/cache-profiles-redis
cache user profiles with redis
2023-03-11 06:42:15 -05:00
Brandon Thomas 75014a673a cache user profiles with redis 2023-03-11 06:41:51 -05:00
Brandon Thomas 52afa5462d Merge pull request #36 from storytold/block-ips
block more IPs
2023-03-11 05:15:40 -05:00
Brandon Thomas a826d54311 block more IPs 2023-03-11 05:15:09 -05:00
Brandon Thomas 4f38e4b20a codegen 2023-03-11 03:44:54 -05:00
Brandon Thomas 6880efd2f0 Merge pull request #35 from storytold/bt-edit-mfactor
edit tts model m-factor (mods only)
2023-03-11 03:42:27 -05:00
Brandon Thomas e372a4b5ec edit tts model m-factor (mods only) 2023-03-11 03:41:59 -05:00
Brandon Thomas f978f1b055 Merge pull request #34 from storytold/bt-inference-test-jobs
test requests bypass the model cache
2023-03-11 02:36:11 -05:00
Brandon Thomas ee69e72661 test requests bypass the model cache 2023-03-11 02:35:50 -05:00
Brandon Thomas 6295fd9569 update queries codegen 2023-03-11 02:09:03 -05:00
Brandon Thomas 53d9d55036 re-build all the things 2023-03-11 01:13:39 -05:00
Brandon Thomas 7e236f1e81 tts job now conveys mel multiplier 2023-03-11 01:12:35 -05:00
Brandon Thomas 6b7370ee64 migrations for mel multiply factor 2023-03-10 23:49:52 -05:00
Brandon Thomas 406d2eb7af rename paths 2023-03-10 05:54:56 -05:00
Brandon Thomas 1cfb3663e9 endpoint disablement filter allows adjustment of online endpoints 2023-03-10 05:50:00 -05:00
Brandon Thomas aa24f781fb remove old ip banlist filter 2023-03-10 04:33:22 -05:00
Brandon Thomas 3a2dad2027 more cleanup, organization, refactor 2023-03-10 03:08:29 -05:00
Brandon Thomas 814c04cdac more cleanup 2023-03-10 02:59:54 -05:00
Brandon Thomas c45a6da8a5 rid database_queries of container_common::anyhow_result 2023-03-10 02:55:57 -05:00
Brandon Thomas a5b2028588 begin removing container_common stuff 2023-03-10 02:53:48 -05:00
Brandon Thomas 4a743bace1 New static IP filter + docker config includes 2023-03-10 02:45:36 -05:00
Brandon Thomas 5ef5d6832b IP lists of attackers to ban 2023-03-10 02:28:35 -05:00
Brandon Thomas 0ebb1e398b Directory to contain IP bans 2023-03-10 02:21:48 -05:00
Brandon Thomas 4be572c36b refactor / organize top level directories 2023-03-10 02:13:16 -05:00
Brandon Thomas 97bea31b1d load an entire directory of bans 2023-03-10 01:49:11 -05:00
Brandon Thomas f3dd785331 load ip sets from file 2023-03-10 01:34:57 -05:00
Brandon Thomas 0d99c2fc08 new ip address filter middleware (wip) 2023-03-10 01:12:37 -05:00
Brandon Thomas edba26a2db cache leaderboard 2023-03-09 18:29:15 -05:00
Brandon Thomas 89a9448c9a new caching logic for get pending tts counts 2023-03-09 18:16:02 -05:00
Brandon Thomas d557c78123 new LRU cache to bypass expiry 2023-03-09 18:06:21 -05:00
Brandon Thomas 9ac7f33008 feature flag to control frontend tts queue refresh rate 2023-03-09 10:47:59 -05:00
Brandon Thomas 716e7923ff Add IP addresses that attacked us 2023-03-09 02:19:51 -05:00
Brandon Thomas ad389491a2 mark dummy service logs 2023-03-09 00:31:00 -05:00
Brandon Thomas 85b5e427b9 Wrap forwarded ip 2023-03-09 00:30:20 -05:00
Brandon Thomas 74d7b543f2 dummy service too 2023-03-08 21:10:09 -05:00
Brandon Thomas 2078bac70f forwarded IP in logs 2023-03-08 21:09:47 -05:00
Brandon Thomas 2e0110b0d9 omfg I'm dumb 2023-03-08 20:49:59 -05:00
Brandon Thomas 80a32eedf3 default route 2023-03-08 20:37:54 -05:00
Brandon Thomas 539c5ae796 with and without compression (messy af hack) 2023-03-08 20:32:54 -05:00
Brandon Thomas 6440d519f9 build dummy service in docker image 2023-03-08 20:17:30 -05:00
Brandon Thomas 690f4f1064 dummy service for debugging 2023-03-08 20:16:35 -05:00
Brandon Thomas a1e4ca35cd configurable health check duration 2023-03-08 18:49:56 -05:00
Brandon Thomas d93c0a5a8d log dropped requests 2023-03-08 17:10:36 -05:00
Brandon Thomas 9cc5ce9a04 faster builds for outage 2023-03-08 16:53:15 -05:00
Brandon Thomas 202b6c4a97 always opt in health checkers 2023-03-08 16:32:09 -05:00
Brandon Thomas 71abf1caa2 fix the pushback filter for the global GKE load balancer 2023-03-08 15:31:52 -05:00
Brandon Thomas de01d0fde7 protect another endpoint (tts model list) with flag 2023-03-08 15:10:57 -05:00
Brandon Thomas bb5ef2a3fe 404 "None" job statuses from broken Python clients 2023-03-08 14:53:14 -05:00
Brandon Thomas a8ab9c1265 Middleware to disable site with 429 global pushback 2023-03-08 14:44:08 -05:00
Brandon Thomas 2412e15868 add a followup github action step 2023-03-08 12:48:12 -05:00
Brandon Thomas 4b45924455 one more disk space report 2023-03-08 12:30:06 -05:00
Brandon Thomas 72ce767337 bump github actions caching plugin 2023-03-08 12:28:06 -05:00
Brandon Thomas 76c562bf2e trying one more thing 2023-03-08 12:24:37 -05:00
Brandon Thomas 6ac8759aba remove check of filesystem at root due to permissions on /proc 2023-03-08 12:23:45 -05:00
Brandon Thomas 3503a4527c disable docker container build tests (for now - emergency) 2023-03-08 12:23:04 -05:00
Brandon Thomas 03160b73d4 Merge pull request #33 from storytold/bt-space-check
report disk usage
2023-03-08 12:15:42 -05:00
Brandon Thomas 601b786b06 report disk usage 2023-03-08 12:15:25 -05:00
Brandon Thomas 05503512d8 Merge pull request #32 from storytold/bt-space
attempt to fix github builds failing for space issues
2023-03-08 11:48:02 -05:00
Brandon Thomas 7db6f074b6 attempt to fix github builds failing for space issues 2023-03-08 11:47:31 -05:00
Brandon Thomas e7ad3a34de Merge pull request #31 from storytold/bt-ff
feature flag to disable tts queue length
2023-03-08 11:28:13 -05:00
Brandon Thomas 5ccd512a2a feature flag to disable tts queue length 2023-03-08 11:27:42 -05:00
Brandon Thomas c40333e2a2 Fixup sqlx offline query caching, fix failing tests, fix docker 2023-03-08 05:56:59 -05:00
Brandon Thomas edcfc9ff9b port final storyteller-web query out: enqueue infer w2l 2023-03-08 05:31:56 -05:00
Brandon Thomas 862be58f1a port "assign/unassign tts category" out of storyteller-web 2023-03-08 05:14:34 -05:00
Brandon Thomas 8b08f2ba1d port "edit w2l template" queries out of storyteller-web 2023-03-08 05:01:49 -05:00
Brandon Thomas fe3f8dec6c port "edit w2l result" queries 2023-03-08 03:30:09 -05:00
Brandon Thomas 8ae5d34074 port the two "edit tts result" queries 2023-03-08 03:14:54 -05:00
Brandon Thomas 89f8837706 port tts upload job status query 2023-03-08 01:05:35 -05:00
Brandon Thomas 03ed0b4c7b analytics queries 2023-03-07 23:57:43 -05:00
Brandon Thomas f1d8161481 port get pending w2l detailed stats out of storyteller-web 2023-03-06 20:03:43 -05:00
Brandon Thomas 2d20430f55 port tts inference stats from storyteller web 2023-03-06 19:56:26 -05:00
Brandon Thomas e2b98491cb port storyteller-web query: insert w2l template upload job 2023-03-06 19:21:14 -05:00
Brandon Thomas 910caa1000 port storyteller-web get w2l inference job status 2023-03-06 18:58:15 -05:00
Brandon Thomas 0e39999097 port query get upload w2l template status 2023-03-06 06:03:59 -05:00
Brandon Thomas 77779bc231 port insert tts upload job query 2023-03-06 05:47:51 -05:00
Brandon Thomas 898c22b9cc port "edit category" out of storyteller-web 2023-03-06 05:28:17 -05:00
Brandon Thomas 96b80b35a5 port query: set w2l template mod approval 2023-03-06 05:16:22 -05:00
Brandon Thomas d182f800f7 port query: inference job status 2023-03-06 05:07:43 -05:00
Brandon Thomas 60af92ea39 port storyteller-web query: pending w2l template list 2023-03-06 04:57:45 -05:00
Brandon Thomas da8c164b40 port storyteller-web query: create category 2023-03-06 04:49:36 -05:00
Brandon Thomas d304f40984 port useless query - should have just deleted this one 2023-03-06 04:41:05 -05:00
Brandon Thomas 8f0d347c38 move storyteller-web query: set user role 2023-03-06 04:27:34 -05:00
Brandon Thomas 73db1b1a49 move another storyteller web query: category soft delete 2023-03-06 04:18:58 -05:00
Brandon Thomas 97b7120ff8 move another storyteller-web query: ban user 2023-03-06 04:07:46 -05:00
Brandon Thomas 961c5cf43d remove another storyteller-web query: upsert ip ban 2023-03-06 03:58:47 -05:00
Brandon Thomas 4c2c54bd74 Merge pull request #30 from storytold/bt-extract-queries
Bt extract queries
2023-03-06 02:05:03 -05:00
Brandon Thomas c158097b42 move queries for public event feed out of storyteller-web 2023-03-06 02:01:46 -05:00
Brandon Thomas 1c9366da4b remove another storyteller-web query : staff 2023-03-06 02:01:46 -05:00
Brandon Thomas f648f7b714 port db query for toggle IP ban out of storyteller-web 2023-03-06 02:01:46 -05:00
Brandon Thomas c3db6ce24a remove another ip ban query from storyteller-web 2023-03-06 02:01:46 -05:00
Brandon Thomas 1910b6497c get rid of storyteller-web list ip bans query 2023-03-06 02:01:46 -05:00
Brandon Thomas ac90b89230 SQL codegen for MySQL + Sqlite 2023-03-02 05:46:53 -05:00
Brandon Thomas 70e6ba5aec codegen db 2023-02-26 00:12:58 -05:00
Brandon Thomas 5af6a68de7 Random init news story progress - better for initial mix of stories 2023-02-24 04:21:26 -05:00
Brandon Thomas 19532388a3 work on selecting random stories to scrape 2023-02-24 04:05:03 -05:00
Brandon Thomas 27adc9f73e gizmodo + kotaku in app scraping 2023-02-24 03:41:12 -05:00
Brandon Thomas 6d082f2b9e Kotaku + Gizmodo RSS indexers 2023-02-24 03:18:00 -05:00
Brandon Thomas 2c86a4189c kotaku scraper 2023-02-24 02:49:02 -05:00
Brandon Thomas bf5b2b385e CNN timestamps 2023-02-24 02:33:37 -05:00
Brandon Thomas b7c73930b4 CNN timestamps 2023-02-24 02:20:36 -05:00
Brandon Thomas f9d61a1482 Gizmodo scraper 2023-02-24 01:50:08 -05:00
Brandon Thomas 4799d3ceac CBS News scraper 2023-02-24 01:21:29 -05:00
Brandon Thomas 696fd2bd8d Add timestamp to theguardian scraper 2023-02-24 00:45:10 -05:00
Brandon Thomas 1cfb3bb715 TheGuardian scraper 2023-02-23 19:21:19 -05:00
Brandon Thomas ccb36f7f6e CLI utility to test parsing 2023-02-23 18:57:23 -05:00
Brandon Thomas 83a16f83e3 fix builds? 2023-02-23 17:19:16 -05:00
Brandon Thomas 8f9554be9f try to fix builds again 2023-02-23 05:10:10 -05:00
Brandon Thomas d987397586 fix builds? 2023-02-23 02:54:29 -05:00
Brandon Thomas 41e03feb85 more analytics queries 2023-02-23 02:15:04 -05:00
Brandon Thomas 5c8cab0d90 extra analysis query 2023-02-23 01:35:03 -05:00
Brandon Thomas 8f40db9a3e return short news title in HTTP endpoint 2023-02-22 08:36:18 -05:00
Brandon Thomas b0a7c953be Try to remove stories that have TTS strokes 2023-02-22 08:29:06 -05:00
Brandon Thomas a08bc3fa64 include outputs in table, cleanup bugs 2023-02-22 07:51:53 -05:00
Brandon Thomas 5d111f0a68 fix job queue state flow 2023-02-22 07:35:45 -05:00
Brandon Thomas 51a5571d84 new jobs: LLM title summary, LLM categorization 2023-02-22 07:28:04 -05:00
Brandon Thomas 95f2ec3e40 Add new status columns to list queries 2023-02-22 06:02:10 -05:00
Brandon Thomas b511420c03 Refactor to group news story tasks by phase 2023-02-22 05:14:07 -05:00
Brandon Thomas aeab9da077 Summary news title and categories DB migrations 2023-02-22 04:57:05 -05:00
Brandon Thomas 46452415fd hanashi v3 2023-02-21 23:06:42 -05:00
Brandon Thomas cecbc8e730 report headline image url 2023-02-20 05:41:59 -05:00
Brandon Thomas 1ba73c817c Avoid empty scraped articles 2023-02-20 05:37:59 -05:00
Brandon Thomas 8395739500 save debugging info 2023-02-20 05:23:07 -05:00
Brandon Thomas c537f09c8f Image generation works! 2023-02-20 05:09:35 -05:00
Brandon Thomas 1e7de6bf36 hanashi v2, include cnn entertainment feed 2023-02-19 06:35:22 -05:00
Brandon Thomas ab6e3ceb5a get rid of ads 2023-02-19 06:21:11 -05:00
Brandon Thomas 896938b762 begin work on per-website greenlighting 2023-02-19 06:05:48 -05:00
Brandon Thomas 486960905d Add web_content_type to news_stories and news_story_productions 2023-02-19 05:57:36 -05:00
Brandon Thomas 2a54d3aac9 switch voices at runtime 2023-02-18 06:58:13 -05:00
Brandon Thomas 10ac9fee82 GUI dropdown (non-functional), window size 2023-02-18 06:38:59 -05:00
Brandon Thomas cab4840a61 Sigil value in API for UNREAL's sake. Ugh. 2023-02-18 03:04:07 -05:00
Brandon Thomas 68a3c123eb Include all news stories if "recent" is an empty list 2023-02-18 01:19:41 -05:00
Brandon Thomas 582ce9aa93 more debugging 2023-02-18 01:13:27 -05:00
Brandon Thomas eaeb864c1c debugging for endpoints 2023-02-16 05:56:05 -05:00
Brandon Thomas 77d4bc3b75 working retry 2023-02-16 04:50:51 -05:00
Brandon Thomas b6be95144c FakeYou with backoff 2023-02-16 04:40:24 -05:00
Brandon Thomas 5ca4dd3600 use session cookie credentials instead, because API sessions broken 2023-02-16 03:53:00 -05:00
Brandon Thomas 294c3107b5 API token for channels 2023-02-16 02:41:45 -05:00
Brandon Thomas 2de7ce146f increase sqlite "connections"(??) to improve performance 2023-02-16 02:28:53 -05:00
Brandon Thomas f7ddd24325 Get next audio file in sequence 2023-02-16 02:26:48 -05:00
Brandon Thomas 1b1ed15f21 endpoint for random news story 2023-02-15 04:55:46 -05:00
Brandon Thomas dc93602306 track audio durations in db 2023-02-15 04:04:21 -05:00
Brandon Thomas 2898f40ad1 Fix errors 2023-02-15 03:34:27 -05:00
Brandon Thomas ced51c7f58 track extra metadata throughout production 2023-02-15 03:20:38 -05:00
Brandon Thomas b208847ec8 insert news story, tighten up timings 2023-02-15 02:48:15 -05:00
Brandon Thomas 744656cfd9 remove imgui (we're not using it) 2023-02-15 01:33:22 -05:00
Brandon Thomas a735d3e972 sequence length 2023-02-15 01:24:16 -05:00
Brandon Thomas 90aa091398 refactor tts_render_targets -> tts_render_tasks 2023-02-15 01:12:58 -05:00
Brandon Thomas f8e7ae3ced preproduction story finalization 2023-02-14 13:09:22 -05:00
Brandon Thomas a1b8a22225 Download files 2023-02-14 12:47:23 -05:00
Brandon Thomas 0a0105410d Get updated audio status 2023-02-14 05:13:57 -05:00
Brandon Thomas 69a79b76ea seems to work better? 2023-02-14 04:26:53 -05:00
Brandon Thomas 809387958c cleanup 2023-02-14 03:29:46 -05:00
Brandon Thomas 44f7824910 cleanup 2023-02-14 02:59:29 -05:00
Brandon Thomas 1e05dcb7e2 Add sequence order 2023-02-14 02:47:07 -05:00
Brandon Thomas 72bdea7d10 Record inference details 2023-02-14 02:22:00 -05:00
Brandon Thomas c3981e8554 idempotency crate, FakeYou requests to infer work 2023-02-14 02:03:31 -05:00
Brandon Thomas 6b937b7cd0 FakeYou rendering *almost* works 2023-02-14 01:37:26 -05:00
Brandon Thomas 5be10ae87a refactor/organize worker modules 2023-02-13 21:32:46 -05:00
Brandon Thomas 12f7e30047 fakeyou client 2023-02-13 21:25:43 -05:00
Brandon Thomas a5e0c2ab01 reorganize analytics queries 2023-02-13 17:39:58 -05:00
Brandon Thomas 0764711439 pause controls for scraping 2023-02-13 17:12:12 -05:00
Brandon Thomas 969be4726c easier concurrency atomic bools, add controls for pieces 2023-02-13 17:05:22 -05:00
Brandon Thomas 8244bac6e1 tweak timings 2023-02-13 04:52:41 -05:00
Brandon Thomas 1d173a74d5 split into paragraph heuristic 2023-02-13 04:34:24 -05:00
Brandon Thomas 3786a64eb1 text splitting 2023-02-13 03:49:01 -05:00
Brandon Thomas cc6cf0d6c0 "add dragon", as old colleagues would say
Maybe one day we can afford to buy Nintendo. (That's crazy.)
2023-02-12 22:53:56 -05:00
Brandon Thomas 144df6ffc0 refactor to make llm rendition a part of production flow 2023-02-12 17:52:18 -05:00
Brandon Thomas 85e0ce4b4a Greenlighting stories + production workflow (abstract, but will use) 2023-02-12 15:54:26 -05:00
Brandon Thomas 107d11f0f9 Analysis of paying subscribers 2023-02-12 02:40:11 -05:00
Brandon Thomas 7efb65ae08 new tables 2023-02-10 21:26:14 -05:00
Brandon Thomas ba3ff9768a WIP - tables for stories 2023-02-10 06:28:55 -05:00
Brandon Thomas b8e37d2e77 mark jobs done 2023-02-10 03:49:45 -05:00
Brandon Thomas 5a1e61b692 add some filters 2023-02-10 01:16:51 -05:00
Brandon Thomas 19b57b9c1d unused module 2023-02-10 00:41:57 -05:00
Brandon Thomas 6c33c31289 skip CNN video content 2023-02-08 05:13:45 -05:00
Brandon Thomas b1bbfe21ec OpenAI API calls 2023-02-08 03:36:41 -05:00
Brandon Thomas 5878224f7e rendition schema 2023-02-07 22:40:35 -05:00
Brandon Thomas 5497b7c0aa small refactor 2023-02-07 18:54:23 -05:00
Brandon Thomas bc58b50408 shared title/image extractors 2023-02-07 17:50:58 -05:00
Brandon Thomas ce17a3e1bf CNN articles, shared extractors 2023-02-07 17:13:07 -05:00
Brandon Thomas b8fe3a0e7d fix pagination bugs 2023-02-07 03:04:04 -05:00
Brandon Thomas d41cec6c90 cleanup log spam 2023-02-07 02:24:44 -05:00
Brandon Thomas 6a86f43a92 scraping appears to work 2023-02-07 02:18:00 -05:00
Brandon Thomas 65a7a46914 finish refactoring macros 2023-02-06 23:53:19 -05:00
Brandon Thomas 31eafed60d refactor database enum macros 2023-02-06 23:51:30 -05:00
Brandon Thomas 6abbbaae01 list query, enum macros for web_scraping_targets (sqlite) 2023-02-06 23:46:22 -05:00
Brandon Thomas 82efbf4d1f update docs 2023-02-06 22:10:12 -05:00
Brandon Thomas b1cefa66d5 docs about windows setup 2023-02-06 22:09:03 -05:00
Brandon Thomas 7f5f578abd ignore this mess 2023-02-06 21:58:47 -05:00
Brandon Thomas 0c574c31d6 update path 2023-02-06 18:42:31 -05:00
Brandon Thomas 393bc084d4 scope aichatbot to sqlite 2023-02-06 18:38:33 -05:00
Brandon Thomas 035faa0561 update launch script 2023-02-06 17:56:32 -05:00
Brandon Thomas 84e2bcd2c3 sqlite library for windows 2023-02-06 16:37:12 -05:00
Brandon Thomas bc69ecbda5 start script for windows 2023-02-06 16:17:16 -05:00
Brandon Thomas 5f35323a5f fixes for windows 2023-02-06 16:14:24 -05:00
Brandon Thomas 30c9f779bd outline remaining work 2023-02-06 05:00:32 -05:00
Brandon Thomas 4f7d03a505 index cnn + techcrunch 2023-02-06 04:56:49 -05:00
Brandon Thomas 5a031b1b80 indexer flow 2023-02-06 04:49:28 -05:00
Brandon Thomas d1b6facd95 worker threads 2023-02-06 04:46:10 -05:00
Brandon Thomas 79984058c0 Save webpage and scraping summary 2023-02-06 03:56:51 -05:00
Brandon Thomas adc52cd01e directory to persist html 2023-02-06 03:32:07 -05:00
Brandon Thomas aad257a1b2 fully refactor "hashing" out of container_common 2023-02-06 03:18:53 -05:00
Brandon Thomas b8d5a1fad1 hashing refactor 2023-02-06 03:06:01 -05:00
Brandon Thomas f757b94eaf refactor "hashing" 2023-02-06 03:02:23 -05:00
Brandon Thomas 8ff2408cbf begin to work on persisting scraping 2023-02-06 02:47:21 -05:00
Brandon Thomas 01fa2f8d67 serde 2023-02-05 17:35:44 -05:00
Brandon Thomas 25b7024655 title, more fields 2023-02-05 17:32:29 -05:00
Brandon Thomas f7b8423623 techcrunch parsing sort of works 2023-02-05 16:29:17 -05:00
Brandon Thomas 0f99360c20 the guardian 2023-02-05 05:54:25 -05:00
Brandon Thomas fe606c1610 three techcrunch feeds 2023-02-05 05:28:39 -05:00
Brandon Thomas 201481f969 handle TechCrunch venture feed 2023-02-05 05:24:54 -05:00
Brandon Thomas 665cd83739 techcrunch scraping of RSS feed 2023-02-05 05:12:42 -05:00
Brandon Thomas eefe48f8ca CNN candidate articles via RSS + Sqlite inserts 2023-02-05 05:02:13 -05:00
Brandon Thomas a1c5ef6eb2 add sqlite columns, move database 2023-02-05 03:44:02 -05:00
Brandon Thomas 2f4fe2dabc Web scraping WIP 2023-02-05 03:36:17 -05:00
Brandon Thomas d63a505b8b comments in .gitignore, aichatbot diesel configs 2023-02-05 01:41:08 -05:00
Brandon Thomas fb1bf9940e move migrations dir 2023-02-05 01:32:34 -05:00
Brandon Thomas d4de388bb6 new reserved usernames for channels 2023-02-05 01:21:57 -05:00
Brandon Thomas a0a5c68086 Project outline 2023-02-04 18:24:45 -05:00
Brandon Thomas ddb106a9af reqwest, ingestion modules (wip) 2023-02-03 23:57:12 -05:00
Brandon Thomas 7c229ba59b fix 2023-02-03 06:00:21 -05:00
Brandon Thomas d1978298f0 unixy paths 2023-02-03 05:57:41 -05:00
Brandon Thomas 1dcf06b571 fix? 2023-02-03 05:50:37 -05:00
Brandon Thomas 8af2368f32 fix? 2023-02-03 05:46:29 -05:00
Brandon Thomas 79fba33aae more debugging 2023-02-03 05:44:38 -05:00
Brandon Thomas bff0f9181d debugging 2023-02-03 05:42:27 -05:00
Brandon Thomas bd8f2570e2 report audio filename 2023-02-03 05:37:29 -05:00
Brandon Thomas 74c289b338 refactor sidecar, save dir 2023-02-03 05:17:09 -05:00
Brandon Thomas 63bb0e7253 cursor 2023-02-03 03:45:17 -05:00
Brandon Thomas 4140d07924 OpenAI API calls 2023-02-03 02:09:55 -05:00
Brandon Thomas aa03abd3b5 Merge pull request #28 from storytold/saj-unsubscribe-reason
endpoint for indicating why a user is unsubscribing
2023-02-03 01:33:54 -05:00
Paul Sajna fb8142fb49 endpoint for indicating why a user is unsubscribing 2023-02-02 22:25:00 -08:00
Brandon Thomas 362f41cbf3 Webserver + Egui synced 2023-02-02 17:55:04 -05:00
Brandon Thomas a79d3bcf9a fix windows builds? 2023-02-02 16:17:01 -05:00
Brandon Thomas 41e7780fa0 fix builds ? 2023-02-02 15:57:22 -05:00
Brandon Thomas 329e7defc5 update paths 2023-02-02 15:54:41 -05:00
Brandon Thomas 6ce0437aa2 ignore some code from Github language statistics 2023-02-02 15:52:33 -05:00
Brandon Thomas 34bb2c5266 ACTUALLY YOU CAN LAUNCH ACTIX FROM ANOTHER THREAD 2023-02-02 15:41:56 -05:00
Brandon Thomas 2b50d2bce5 new lib: actix_helpers (RouteBuilder), --gui, etc. 2023-02-02 15:33:01 -05:00
Brandon Thomas c9f55fbb7c Still issues with launching a gui on non-main thread; add fonts 2023-02-02 12:22:53 -05:00
Brandon Thomas 2da4971ec7 analytics query adjustments 2023-02-02 11:56:53 -05:00
Brandon Thomas 2cd6a98259 egui wants to run on main thread; so does actix. ugh 2023-02-02 04:38:43 -05:00
Brandon Thomas 7ba765b89c Setting up aichatbot-sidecar desktop program 2023-02-02 01:40:44 -05:00
Brandon Thomas 02d7495e54 kick this can down the road _again_ 2023-02-02 00:43:59 -05:00
Brandon Thomas 088535cb5a refactor/move "plugins" crate to pertain only to services 2023-02-02 00:40:01 -05:00
Brandon Thomas 4ef9ad35a7 fix migration dir config 2023-02-02 00:30:30 -05:00
Brandon Thomas f80f2c8962 Move all SQL stuff into single directory 2023-02-01 23:53:49 -05:00
Brandon Thomas 98fb5758e5 I'll see myself out 2023-02-01 19:32:03 -05:00
Brandon Thomas 06f219a8af more reserved names 2023-02-01 19:30:30 -05:00
Brandon Thomas 439527a504 more reserved words 2023-02-01 19:26:00 -05:00
Brandon Thomas 61e1cc62b6 analytics query 2023-01-30 01:20:06 -05:00
Brandon Thomas 633dfb5682 more queries 2023-01-29 20:58:03 -05:00
Brandon Thomas 8df0273ca8 more analysis 2023-01-29 20:17:50 -05:00
Brandon Thomas 41630e1fc5 paying user analytics 2023-01-29 20:09:28 -05:00
Brandon Thomas 40bc0cf883 never need 500 voices in analytics 2023-01-27 02:33:00 -05:00
Brandon Thomas 7fdb5cfe9c codegen db 2023-01-26 01:17:27 -05:00
Brandon Thomas a0da010dab Add model ratings to TTS list and get endpoints 2023-01-26 01:12:20 -05:00
Brandon Thomas 74ff632f4d update TTS statistics on model rate 2023-01-26 01:12:20 -05:00
Brandon Thomas e6d1f0db11 Alter tts_models to add ratings counts 2023-01-26 01:12:20 -05:00
Brandon Thomas d190173f4d new queries 2023-01-25 16:29:25 -05:00
Brandon Thomas 22e8a14170 Fix build errors and mistakes with user ratings 2023-01-25 16:24:44 -05:00
Brandon Thomas b6fce130b5 GET and POST endpoints for user ratings 2023-01-25 16:08:22 -05:00
Brandon Thomas 1bb0dda330 Rating type instead of bool, upsert query, enums 2023-01-25 02:33:56 -05:00
Brandon Thomas bcbb36a9ed User ratings table 2023-01-25 00:47:35 -05:00
Brandon Thomas dbfd80531d analytics query 2023-01-23 23:21:44 -05:00
Brandon Thomas 4152b346c1 Server info endpoint to report backend SHA 2023-01-21 03:17:49 -05:00
Brandon Thomas 3b37cf9e89 analytics query 2023-01-20 06:22:40 -05:00
Brandon Thomas c49bbd299a analytics queries for category assignments 2023-01-20 05:42:54 -05:00
Brandon Thomas 993fe647b4 remove whitespace from TTS model titles 2023-01-20 03:27:39 -05:00
Brandon Thomas d46778569c Add Arabic and Turkish language support (serverside) 2023-01-20 03:25:17 -05:00
Brandon Thomas 2ea0e1450c Sort tts models returned by category membership endpoint 2023-01-18 01:01:29 -05:00
Brandon Thomas b31bafd639 split up heavy category endpoint into modules 2023-01-17 23:58:53 -05:00
Brandon Thomas 9246ab83cf sort models in category flag 2023-01-17 21:39:23 -05:00
Brandon Thomas 93b06bd8b5 rename synthetic categories 2023-01-17 21:32:22 -05:00
Brandon Thomas 271bce9815 fix trending voices with hack 2023-01-17 07:28:10 -05:00
Brandon Thomas f0bebc6135 ugh, docker typo 2023-01-17 06:39:00 -05:00
Brandon Thomas 98ce37d9a4 re-codegen db 2023-01-17 05:55:29 -05:00
Brandon Thomas b0bc019db2 Merge pull request #27 from storytold/bt-trending-voices
Bt trending voices
2023-01-17 05:50:22 -05:00
Brandon Thomas f3c34d9a7b Trending voices / job 2023-01-17 05:49:23 -05:00
Brandon Thomas 98c8bbda57 Trending voices / analytics table 2023-01-16 16:28:17 -05:00
Brandon Thomas 18b20d6c4d cleanup analytics queries 2023-01-16 16:15:42 -05:00
Brandon Thomas 11fd4881ea re-codegen 2023-01-16 04:57:25 -05:00
Brandon Thomas 7ab39d0b5c Merge pull request #26 from storytold/bt-categories
Work on synthetic categories; "latest models" category
2023-01-16 04:22:39 -05:00
Brandon Thomas 77e16d4bd8 synthetic categories 2023-01-16 04:21:19 -05:00
Brandon Thomas 58c7695a2a Refactor enums 2023-01-16 01:56:38 -05:00
Brandon Thomas 140c93fc76 Work on categories 2023-01-16 01:37:24 -05:00
Brandon Thomas 2b58e3c32d Emit server build SHA from /_status endpoint 2023-01-15 01:40:58 -05:00
Brandon Thomas 142adf10ee ugh, that was stupid af 2023-01-15 01:24:39 -05:00
Brandon Thomas d1698ead1d fix build arg? 2023-01-15 01:24:03 -05:00
Brandon Thomas 2909e2dbb4 reintroduce GIT_SHA to container 2023-01-14 22:42:09 -05:00
Brandon Thomas 9015efdf9e real world language header test 2023-01-14 20:20:41 -05:00
Brandon Thomas 2a5634503f Reorganize tts category handlers 2023-01-14 19:07:57 -05:00
Brandon Thomas 623b82dd0e fix accept-language for q-factor 2023-01-14 06:54:34 -05:00
Brandon Thomas 9fbafd7fcd sqlx 0.4.x -> 0.6.x 2023-01-14 06:39:28 -05:00
Brandon Thomas cc573fe242 return even less nonessential data 2023-01-14 04:32:07 -05:00
Brandon Thomas c4225ce571 Cache computed TTS category assignments 2023-01-14 04:29:48 -05:00
Brandon Thomas 2f6747b98a Merge pull request #25 from storytold/bt-serverside-category-memberships
Compute and cache TTS model category assignments serverside
2023-01-14 00:17:03 -05:00
Brandon Thomas bc5090af54 Compute and cache TTS model category assignments serverside 2023-01-14 00:13:27 -05:00
Brandon Thomas 8062833e8d gzip response payloads 2023-01-12 05:36:14 -05:00
Paul Sajna e5a852acd6 remove rustup override from ci 2023-01-11 18:35:35 -08:00
Brandon Thomas 84ccda1960 default rustup to 1.66 2023-01-11 06:51:06 -05:00
Brandon Thomas 893a861d22 Bump to trigger rebuild (to test build caching) 2023-01-11 06:19:43 -05:00
Brandon Thomas 13b014e7fc bump rust version? 2023-01-11 05:17:41 -05:00
Brandon Thomas c8598bc9e3 Merge pull request #24 from storytold/saj-ci
CI MVP
2023-01-11 04:40:22 -05:00
Brandon Thomas ecf84c4b15 Fix codegen (for reals), notes for mac, perform codegen 2023-01-11 04:31:25 -05:00
Paul Sajna c4ea221c50 test 2023-01-11 00:37:09 -08:00
Brandon Thomas 8de1722466 fix migration script 2023-01-11 03:22:58 -05:00
Paul Sajna a716b8963f ;) 2023-01-11 00:09:39 -08:00
Paul Sajna 7f70de0148 ??? 2023-01-11 00:06:50 -08:00
Brandon Thomas bc033c2202 Merge pull request #23 from storytold/brandon-web-vc
Web-based Voice Conversion Part 1
2023-01-11 03:06:15 -05:00
Paul Sajna 756c357462 attempt to hide brandon's crimes 2023-01-10 23:57:53 -08:00
Paul Sajna 4b8c454c84 getting there? 2023-01-10 23:42:23 -08:00
Paul Sajna d2b3386fea urggggghhhhhhhh 2023-01-10 23:39:47 -08:00
Paul Sajna f458f29109 urgggggh 2023-01-10 23:38:15 -08:00
Paul Sajna aa3faca551 another test 2023-01-10 23:36:50 -08:00
Paul Sajna 2512810e81 another test 2023-01-10 23:35:25 -08:00
Paul Sajna db629a6a0d WIP for testing if github actions has mysql 2023-01-10 23:33:48 -08:00
Brandon Thomas 30202e6e5a Fix build errors. This is largely because inference_job is not done 2023-01-11 01:39:48 -05:00
Brandon Thomas 9a263a01a1 more reserved words 2023-01-11 00:33:40 -05:00
Brandon Thomas 85ae704ab5 more analytics queries 2023-01-11 00:33:40 -05:00
Brandon Thomas b128cdb3f5 inference job handlers 2023-01-11 00:33:40 -05:00
Brandon Thomas 8755e7a533 generic inference job queries 2023-01-11 00:33:40 -05:00
Brandon Thomas 9f873c33e7 Begin refactor of generic inference-job 2023-01-11 00:33:40 -05:00
Brandon Thomas 81302d0e1d Payload for voice conversion inference records 2023-01-11 00:33:40 -05:00
Brandon Thomas 9e589c2b72 Refactor - db enum types into enums crate 2023-01-11 00:33:40 -05:00
Brandon Thomas 7a33c0721a enqueue webvc inference work 2023-01-11 00:33:40 -05:00
Brandon Thomas e1793d71b5 enqueue voice conversion request handler, media synthetic ids, ... 2023-01-11 00:33:40 -05:00
Brandon Thomas 5b20710f96 Upload file to GCS bucket 2023-01-11 00:33:40 -05:00
Brandon Thomas 77e1319b81 'crockford' crate, use crockford entropy for bucket 2023-01-11 00:33:40 -05:00
Brandon Thomas 8061880a83 consolidate upload handling, use new bucket paths 2023-01-11 00:33:40 -05:00
Brandon Thomas 651ed42b64 New 'buckets' crate for cloud storage uploads 2023-01-11 00:33:40 -05:00
Brandon Thomas e870d6f4de rename storage_buckets_common crate -> cloud_storage 2023-01-11 00:33:40 -05:00
Brandon Thomas 16a2e765ca Handle video formats, too 2023-01-11 00:33:40 -05:00
Brandon Thomas ee7626602a Calculate duration for audio files without metadata 2023-01-11 00:33:40 -05:00
Brandon Thomas 533cd5e051 Tests + test data for media uploads 2023-01-11 00:33:40 -05:00
Brandon Thomas 7f51ccd01b file size bytes 2023-01-11 00:33:40 -05:00
Brandon Thomas f2bfcfeb75 audio codec/encoding 2023-01-11 00:33:40 -05:00
Brandon Thomas 603a678378 new errors crate, cleanup media duration calculation 2023-01-11 00:33:40 -05:00
Brandon Thomas 1ba3215881 organize media/files crates 2023-01-11 00:33:40 -05:00
Brandon Thomas c4c5b89118 Calculate audio duration millis 2023-01-11 00:33:40 -05:00
Brandon Thomas 9aaee506ed hash uploaded file 2023-01-11 00:33:40 -05:00
Brandon Thomas ff12990b01 sort _types crates at the top 2023-01-11 00:33:40 -05:00
Brandon Thomas 45b7af9bd2 detect upload mimetype 2023-01-11 00:33:39 -05:00
Brandon Thomas a34aedc375 move sqlx impls to reusable macro 2023-01-11 00:33:39 -05:00
Brandon Thomas cb1e092ccd tests on derived Display/Debug 2023-01-11 00:33:39 -05:00
Brandon Thomas 07d13a4ab5 proper case for enum mysql insert 2023-01-11 00:33:39 -05:00
Brandon Thomas 43c890b27c Hack for sqlx to insert enums into varchar, but case still wrong 2023-01-11 00:33:39 -05:00
Brandon Thomas a1510d45b2 Media uploads "working" from frontend. Need to handle file + upload 2023-01-11 00:33:39 -05:00
Brandon Thomas 32c7354798 Get rid of super legacy CreatorSetVisibility 2023-01-11 00:33:39 -05:00
Brandon Thomas 31bb03d9d3 Sayonara, RecordVisibility 2023-01-11 00:33:39 -05:00
Brandon Thomas 66bb76e60f Goodbye, 'EntityVisibility' 2023-01-11 00:33:39 -05:00
Brandon Thomas 68f2e46540 more tests on enum types 2023-01-11 00:33:39 -05:00
Brandon Thomas d08d3cd543 New 'enums' crate for db "enum-like" fields, composite keys, etc.
This should be useful for:

- Actual enum fields
- Enum-like char/varchar fields
- Composite keys, polymorphic record behavior, etc.

This should also define how these values are returned over the HTTP API
2023-01-11 00:33:39 -05:00
Brandon Thomas e7fc93de86 Mild refactor: tokens, reusable_types under types/ directory 2023-01-11 00:33:39 -05:00
Brandon Thomas deb3671be6 Endpoint for audio uploading 2023-01-11 00:33:39 -05:00
Brandon Thomas 8591f74ff2 Look at "started" w2l jobs too 2023-01-11 00:33:39 -05:00
Brandon Thomas 26587e51e3 More "analytics" (more operational) queries for w2l jobs 2023-01-11 00:33:39 -05:00
Brandon Thomas 2fad965446 "analytics" query to soft delete tts results for a given model 2023-01-11 00:33:39 -05:00
Brandon Thomas c2f4c2c057 Fix hifigan (softvc) model check 2023-01-11 00:33:39 -05:00
Brandon Thomas 51350e6e5c default parameters for local download job 2023-01-11 00:33:39 -05:00
Brandon Thomas 5f598dc516 Fix download-job queries and compile errors 2023-01-11 00:33:39 -05:00
Brandon Thomas 7bcde1e490 queries to handle softvc download (insert) 2023-01-11 00:33:39 -05:00
Brandon Thomas 13d00f6edf partially handle softvc model downloads 2023-01-11 00:33:39 -05:00
Brandon Thomas 91695cde00 downloader job: handle softvc hifigan 2023-01-11 00:33:39 -05:00
Brandon Thomas 91ac868369 new download types 2023-01-11 00:33:39 -05:00
Brandon Thomas 60af0ea36d enum refactor, whew 2023-01-11 00:33:39 -05:00
Brandon Thomas 46280c7877 3x voice conversion tables (models, results, synthetic_ids) 2023-01-11 00:33:39 -05:00
Brandon Thomas 08c2736ea4 More new tables: media_uploads, audit_logs 2023-01-11 00:33:39 -05:00
Brandon Thomas 02bf8808d0 Web + Job queries for generic_inference_jobs 2023-01-11 00:33:39 -05:00
Brandon Thomas 1de10d1b9f Move all service/web/job projects into grouped subdirectories by type 2023-01-11 00:33:39 -05:00
Brandon Thomas b649bb17c5 Web Voice Conversion 2023-01-11 00:33:39 -05:00
Brandon Thomas 587ea70d33 Merge pull request #22 from storytold/sajattack-kubernetes-localdev
Kubernetes localdev
2023-01-10 22:17:23 -05:00
Paul Sajna ffd7793a8d Update local_development_k8s.md 2023-01-10 19:12:27 -08:00
Paul Sajna 6e13777e84 docs? 2023-01-10 18:59:01 -08:00
Paul Sajna b7fd9aa8d1 x86_64-unknown-linux-musl compatibility and volume mount 2023-01-10 18:59:01 -08:00
Paul Sajna 26e91bd990 database migration bugfix 2023-01-10 18:59:01 -08:00
Paul Sajna 61d0cbd385 clean up something I was trying that I no longer need 2023-01-10 18:59:01 -08:00
Paul Sajna 28d7a26d97 storyteller-web api runs successfully 2023-01-10 18:59:01 -08:00
Brandon Thomas 4196a6499b fix download url check 2022-12-19 19:14:19 -05:00
Brandon Thomas 2cf07c1346 Block uploads of invalid video urls for w2l 2022-12-19 18:02:30 -05:00
Brandon Thomas f56ea64dce automate ubuntu setup 2022-12-15 03:59:28 -05:00
Brandon Thomas 5cfb3f50d7 codegen db 2022-12-13 20:52:41 -05:00
Brandon Thomas 5e0851eb09 fix session / loyalty plan test; mark legacy tokens deprecated 2022-12-13 18:42:18 -05:00
Brandon Thomas 0d3ffd3f3b use DownloadJobToken throughout codebase 2022-12-13 18:26:45 -05:00
Brandon Thomas 1b60427ab0 Add UserToken-specific tests so we have a backup in case the macro fails 2022-12-13 18:05:35 -05:00
Brandon Thomas 75ede876d5 More tests 2022-12-13 17:46:46 -05:00
Brandon Thomas 086980318c use enum variants for prefixes 2022-12-13 17:08:12 -05:00
Brandon Thomas c4ca48f399 prefix registry 2022-12-13 16:50:23 -05:00
Brandon Thomas ad88800b4e enum variants to control character set 2022-12-13 15:43:19 -05:00
Brandon Thomas 64e3864140 Macro-defined tests "kind of" work. 2022-12-13 15:32:23 -05:00
Brandon Thomas 81757870ab Crockford constructor 2022-12-13 02:22:23 -05:00
Brandon Thomas 2769a0b3f9 macro to implement common string token methods 2022-12-13 01:27:29 -05:00
Brandon Thomas 89e721e3bc derive serde traits 2022-12-13 00:20:49 -05:00
Brandon Thomas 353aa4211b more tests 2022-12-13 00:16:44 -05:00
Brandon Thomas 422e36b405 add tests 2022-12-12 23:54:09 -05:00
Brandon Thomas 110c7f828f simplify UserToken type as a wrapper type 2022-12-12 23:16:44 -05:00
Brandon Thomas b9e2c87025 use UserToken in an existing flow 2022-12-12 22:44:04 -05:00
Brandon Thomas b1d5244620 WIP tokens crate 2022-12-12 22:34:08 -05:00
Brandon Thomas 7bcb576436 also track subscription status 2022-12-07 18:09:13 -05:00
Brandon Thomas 2e561acbb4 Analytics over top contributors, change loyalty plan slug 2022-12-07 18:05:40 -05:00
Brandon Thomas c1860a0584 add powerstream to reserved usernames 2022-12-07 16:39:40 -05:00
Brandon Thomas 70140c0e7d new slurs I just found 2022-12-07 16:38:27 -05:00
Brandon Thomas cc56deb27c UserBadge moved to reusable_types 2022-12-06 06:39:10 -05:00
Brandon Thomas a15324adee CORS separation by environments + tests 2022-12-04 02:40:28 -05:00
Brandon Thomas fa108a5303 Add more german languages, fix failing test time bomb 2022-12-03 23:25:08 -05:00
Brandon Thomas 7193ddf18b Fix codegen, codegen db, and update docs for dev db setup 2022-12-03 22:30:57 -05:00
Brandon Thomas 21e74c5367 Fix build error with tts-download-job 2022-12-03 17:46:50 -05:00
Brandon Thomas 11304d77cb Italian TTS 2022-12-03 17:42:46 -05:00
Brandon Thomas ba52695f35 root directory option for downloader 2022-12-01 21:52:52 -05:00
Brandon Thomas d28fb07d6d Clean up new consolidated downloader so it can be deployed 2022-12-01 21:44:32 -05:00
Brandon Thomas 740b419989 codegen script for download job and inference job 2022-11-27 16:56:45 -05:00
Brandon Thomas 8f2640c5eb relabel docker image 2022-11-27 16:21:22 -05:00
Brandon Thomas 6e7c708374 Duplicate tts-inference-job into inference-job 2022-11-27 16:07:29 -05:00
Brandon Thomas 7b0066bea5 Bugfix; download-job handles TTS model download (locally tested) 2022-11-27 05:17:02 -05:00
Brandon Thomas 3d3dec1e23 download job can now handle tacotron (untested) 2022-11-27 04:37:49 -05:00
Brandon Thomas 1ac61b7748 GPU support for docker commands 2022-11-27 03:28:30 -05:00
Brandon Thomas 24c9cc2d08 subprocess stuff in its own lib 2022-11-27 03:10:01 -05:00
Brandon Thomas 2392062276 Download script works with docker image 2022-11-27 02:45:17 -05:00
Brandon Thomas 94c74eb9e0 Refactor download job to be easier to generalize 2022-11-26 21:44:41 -05:00
Brandon Thomas 7f5ccac55c rename generic-download-job -> download-job 2022-11-26 20:41:13 -05:00
Brandon Thomas 62c4f2cbe0 Merge branch 'master' of github.com:storytold/storyteller-rust 2022-11-19 02:56:38 -05:00
Brandon Thomas 507f97bef5 note on subscription statuses 2022-11-18 05:27:53 -05:00
Brandon Thomas a628e986e5 analytics query 2022-11-18 05:14:48 -05:00
Brandon Thomas 2fdd3b38ea codegen 2022-11-17 21:45:02 -05:00
Brandon Thomas a3234b3cb4 Add max_decoder_steps / max_duration_seconds to tts job 2022-11-17 21:41:16 -05:00
Brandon Thomas dbf3d541e2 Production plans 2022-11-16 06:05:59 -05:00
Brandon Thomas f690c73ebf Force environmental plans 2022-11-16 05:42:18 -05:00
Brandon Thomas 567f3143d4 fix test failure 2022-11-16 04:16:42 -05:00
Brandon Thomas 2416056f6f list subscriptions endpoint 2022-11-16 03:10:07 -05:00
Brandon Thomas e390a7d1ac fix endpoint to accept json 2022-11-16 01:28:23 -05:00
Brandon Thomas 00ab91b05c new development stripe plan, minor method name refactor 2022-11-15 23:31:30 -05:00
Brandon Thomas b403ed7c9e Customer portal JSON handler 2022-11-15 19:07:42 -05:00
Brandon Thomas 049b0cf375 rename directory 2022-11-14 21:36:07 -05:00
Brandon Thomas 0e6657e9b7 fix short sha tagging? 2022-11-14 11:13:10 -05:00
Brandon Thomas acdea58a81 tag with short SHA 2022-11-14 11:12:19 -05:00
Brandon Thomas 9711a60494 test build caching of leaf dependency 2022-11-14 05:51:02 -05:00
Brandon Thomas 8edbb3efda revert dockerfile 2022-11-14 04:51:25 -05:00
Brandon Thomas 87b319b99a tagging image again (this might work) 2022-11-14 04:46:49 -05:00
Brandon Thomas ed6f19c2ab test image tagging 2022-11-14 04:39:01 -05:00
Brandon Thomas 31fc96c356 attempt to tag image 2022-11-14 04:35:26 -05:00
Brandon Thomas 4b6eab5a1d fix image name? 2022-11-14 04:33:31 -05:00
Brandon Thomas 6af1234095 attempt to fix github action build (temporarily broke dockerfile) 2022-11-14 04:31:18 -05:00
Brandon Thomas 8132a0bcb0 Attempt to use build caching 2022-11-14 03:55:57 -05:00
Brandon Thomas c679aa3430 Clean up dockerfile, add notes 2022-11-14 03:07:19 -05:00
Brandon Thomas 33485670dd Remove Python models (see storyteller-ml repo), rework Dockerfile
- TTS and W2L were moved to storyteller-ml. TTS has been hosted there
  for a while, but W2L will need to be reworked.

- Restructure Dockerfile to remove old Python deps.

- Also begin using "cargo-chef". Unsure if this will work to speed things up.
2022-11-14 00:39:41 -05:00
Brandon Thomas 9008e7c044 codegen 2022-11-13 23:09:31 -05:00
Brandon Thomas 2d2a0b68ff fix errors from last yolo-commit 2022-11-13 17:37:12 -05:00
Brandon Thomas a211d45f26 on-prem worker stats 2022-11-13 16:42:18 -05:00
Brandon Thomas d20d8a4c1c Not a slur 2022-11-13 16:14:30 -05:00
Brandon Thomas 9aec48d237 placeholder 2022-11-07 12:47:38 -05:00
Brandon Thomas e4835258cb deletion queries 2022-11-02 23:24:35 -04:00
Brandon Thomas f34fd6fc4c re-codegen tts job queries 2022-11-02 23:02:20 -04:00
Brandon Thomas 413d1b7c1c Merge pull request #21 from storytold/tts-job-debugging
Log failure metadata for TTS inference jobs
2022-11-02 22:54:25 -04:00
Brandon Thomas fb99af8a23 Log failure metadata for TTS inference jobs 2022-11-02 22:51:47 -04:00
Brandon Thomas 23b0dab44f re-codegen sqlx 2022-11-02 16:41:03 -04:00
Brandon Thomas 8ee5eca076 Add debugging info to tts_inference_jobs table; move app routes 2022-11-02 16:28:45 -04:00
Brandon Thomas 9a1df0cd8c Merge pull request #20 from storytold/premium-tts
Premium tts
2022-11-02 05:28:54 -04:00
Brandon Thomas 5377cca3b1 TTS now has premium features 2022-11-02 04:36:19 -04:00
Brandon Thomas badcb4b058 Migrations to add duration controls to inference jobs 2022-11-02 00:36:36 -04:00
Brandon Thomas 28a4f5ca8d Merge pull request #19 from storytold/subscription-schema-migrations-2
Migrations to change/rename some columns
2022-11-01 23:39:23 -04:00
Brandon Thomas 3efe1afa48 Migrations to change/rename some columns 2022-11-01 23:33:59 -04:00
Brandon Thomas d4a7c06f72 Merge pull request #18 from storytold/premium-plans-sessions
Premium plans sessions
2022-11-01 06:56:19 -04:00
Brandon Thomas 6b4d0b3ad1 Adding premium info to sessions 2022-11-01 06:39:59 -04:00
Brandon Thomas 23f6e74fd8 ugh, a gross refactor commit 2022-11-01 03:19:08 -04:00
Brandon Thomas 778d7eba7e Premium plans + session changes 2022-11-01 01:54:07 -04:00
Brandon Thomas e5db702289 SSL local dev instructions 2022-10-31 01:46:31 -04:00
Brandon Thomas 4eb400867a Merge pull request #17 from storytold/url-configs
Url configs
2022-10-31 01:32:38 -04:00
Brandon Thomas 4584e9dbcf Cors and local nginx configs for dev.fakeyou.com etc. 2022-10-31 01:31:46 -04:00
Brandon Thomas 2ca477fd8c Better environment-based URL configuration 2022-10-31 00:07:34 -04:00
Brandon Thomas 13487a9046 Fix bug with upsert not changing the product key 2022-10-30 05:25:22 -04:00
Brandon Thomas aff94446ac Merge pull request #16 from storytold/stripe-customer-portal
Stripe customer portal (subscription cancellation / modification)
2022-10-30 05:04:36 -04:00
Brandon Thomas 15c9c1256b Stripe customer portal (subscription cancellation / modification) 2022-10-30 04:57:10 -04:00
Brandon Thomas 009d0eab87 CLI crates
(was building a stripe tool, but need to remember to make DB tools)
2022-10-29 22:20:26 -04:00
Brandon Thomas 0d9a882f3f Refactor stripe component modules 2022-10-27 04:36:43 -04:00
Brandon Thomas 4c878e332e upgrade breaking transitive dependency? 2022-10-25 05:13:24 -04:00
Brandon Thomas d22242ab69 Merge pull request #15 from storytold/product-integration-2
Continued work on product integration
2022-10-25 05:03:19 -04:00
Brandon Thomas 5ee51ed8e2 Continued work on product integration 2022-10-25 05:02:52 -04:00
Brandon Thomas 560448f1ad Merge pull request #14 from storytold/product-integration
Integrate stripe / product crate
2022-10-24 23:03:27 -04:00
Brandon Thomas 1b40495ef3 Integrate stripe / product crate
Associates internal metadata with stripe subscription and better
composes both systems
2022-10-24 23:02:16 -04:00
Brandon Thomas e8d376a3eb Merge pull request #13 from storytold/premium-plans
Premium plan definitions
2022-10-23 00:44:34 -04:00
Brandon Thomas 8e6c02d1b1 Premium plan definitions 2022-10-23 00:43:53 -04:00
Brandon Thomas 4e4dbf0688 Premium plans config (just getting started on this) 2022-10-21 19:18:37 -04:00
Brandon Thomas 1ca54927d7 fix compile errors 2022-10-21 03:19:28 -04:00
Brandon Thomas ddd29ada80 This appears to fix openssl!? Transitive dep update. 2022-10-21 03:17:00 -04:00
Brandon Thomas 5ef27bb86f Merge pull request #12 from storytold/tts-failure-slowdown
Slow down jobs on repeated failures
2022-10-21 00:46:34 -04:00
Brandon Thomas c03bdba0a6 Slow down jobs on repeated failures 2022-10-21 00:46:00 -04:00
Brandon Thomas 14432e9808 Fix build errors (couldn't run build on Linux due to SSL breaks) 2022-10-09 06:06:56 -04:00
Brandon Thomas 1204ac5399 Merge pull request #11 from storytold/desktop-app-api-stubs
Stub API for the desktop app
2022-10-09 05:47:39 -04:00
Brandon Thomas 468d2d1d75 stupid time bomb 2022-10-09 05:46:49 -04:00
Brandon Thomas aac2af635b Stub API for the desktop app 2022-10-09 05:45:11 -04:00
Brandon Thomas 90c96b5f50 codegen from mac (broken on Ubuntu?) 2022-10-09 04:47:32 -04:00
Brandon Thomas 207e63a5aa Merge pull request #10 from storytold/echelon-stripe
merge incomplete arc of work
2022-10-09 03:50:06 -04:00
Brandon Thomas 399ed6cb2e fscking sqlx and ubuntu 22.04 ssl - wtf
I can't link against Ubuntu 22.04 native tls

I can't get rustls to work

wtf
2022-10-09 03:48:23 -04:00
Brandon Thomas d51d6720e6 Setup on a more modern Ubuntu 2022-10-09 02:58:16 -04:00
Brandon Thomas 8f807a7719 wip 2022-09-22 05:36:16 -04:00
Brandon Thomas c8ba2d1863 include price, make adjustments to subscription product/price 2022-09-19 06:30:49 -04:00
Brandon Thomas 2f3cbd4523 handle terminated subscriptions 2022-09-19 05:16:56 -04:00
Brandon Thomas cf7cd9945d Handle grace period days 2022-09-19 04:39:51 -04:00
Brandon Thomas 6a2a99741e cancel_at_period_end and new test 2022-09-19 04:35:59 -04:00
Brandon Thomas dc115a7aa1 begin handling deleted subscriptions 2022-09-19 04:18:08 -04:00
Brandon Thomas 6ea1bf3226 handle events with idempotency by ignoring replays 2022-09-19 04:11:35 -04:00
Brandon Thomas 334fc3022e record whether webhook events had actions taken, idempotency flag 2022-09-19 03:54:32 -04:00
Brandon Thomas 3fb26771de subscription interval tracked 2022-09-19 03:35:30 -04:00
Brandon Thomas ba448ccc50 record subscription billing periods, start date 2022-09-19 02:09:35 -04:00
Brandon Thomas fd3081e440 Track status as an enum, don't update at terminal state 2022-09-19 01:36:01 -04:00
Brandon Thomas 66981c4d2c Track subscription status 2022-09-19 00:26:16 -04:00
Brandon Thomas c6a1fc18d6 coalesce nulls 2022-09-19 00:12:21 -04:00
Brandon Thomas afb77393c0 Don't update on create if already existing, make user token optional 2022-09-19 00:02:52 -04:00
Brandon Thomas a2e71d8944 Handle subscription update and create 2022-09-18 23:26:39 -04:00
Brandon Thomas ca63e00905 user subscriptions 2022-09-18 19:52:11 -04:00
Brandon Thomas faf689dc09 log more info from webhooks 2022-09-17 13:33:22 -04:00
Brandon Thomas aec31779b8 store webhook logs 2022-09-17 13:02:10 -04:00
Brandon Thomas 452a3473b3 WIP schema 2022-09-17 12:06:21 -04:00
Brandon Thomas 00322c6ed4 tests 2022-09-12 06:53:16 -04:00
Brandon Thomas 6dd02d48c4 extractor 2022-09-12 06:33:20 -04:00
Brandon Thomas 2eaf7c499e subscription extractor 2022-09-11 22:18:43 -04:00
Brandon Thomas 3b82e7a389 tests 2022-09-11 21:37:40 -04:00
Brandon Thomas c825f17672 wip 2022-09-11 03:40:18 -04:00
Brandon Thomas 6bbf4453da notes 2022-09-10 20:11:49 -04:00
Brandon Thomas dda247b5ea Handle payment intent success 2022-09-10 18:57:13 -04:00
Brandon Thomas f0435804ec one-time payment 2022-09-10 18:24:45 -04:00
Brandon Thomas 176feda73b wip 2022-09-10 17:41:45 -04:00
Brandon Thomas f81d40b5bb Make logging less verbose 2022-09-10 05:42:50 -04:00
Brandon Thomas c07f100986 wip 2022-09-10 04:26:24 -04:00
Brandon Thomas 9feded54bd most of the events we want 2022-09-10 04:26:24 -04:00
Brandon Thomas 4acec068aa asdhfahsdf 2022-09-10 04:26:24 -04:00
Brandon Thomas e1d4c0f5f3 ugh, I hate this part of the project 2022-09-10 04:26:24 -04:00
Brandon Thomas f066658c3c Move in-progress Stripe / billing work to shared component crate 2022-09-10 04:26:24 -04:00
Brandon Thomas 17021f04b9 fml payments 2022-09-10 04:26:24 -04:00
Brandon Thomas 0e5b4599bb stripe wip 2022-09-10 04:26:24 -04:00
Brandon Thomas 02e7d1f4fa Stripe WIP 2022-09-10 04:26:24 -04:00
Brandon Thomas 360a389e3d Add stripe payments support 2022-09-10 04:26:22 -04:00
Brandon Thomas 999d73db81 analytics queries 2022-09-10 00:53:25 -04:00
Brandon Thomas ec1f5edd5c on-prem analytics queries 2022-09-09 14:40:41 -04:00
Brandon Thomas 2bc00dd6ca comment describing why to include this in the dockerfile 2022-09-09 14:11:08 -04:00
Brandon Thomas 6e6253bf86 dockerfile fixes? 2022-09-09 04:41:48 -04:00
Brandon Thomas 97e6fdc51b Downgrade docker rust build Ubuntu 22.04 -> 20.04 for openssl bug 2022-09-09 04:01:43 -04:00
Brandon Thomas 3cb9afa074 Update Dockerfile to point to new base Rust image 2022-09-09 02:26:38 -04:00
Brandon Thomas 34d08bce61 Not sure what recently broke with the dockerfile. Print Rust versions 2022-09-09 01:25:49 -04:00
Brandon Thomas 3b3603d7cf How did I forget to include the lock file? ugh. 2022-09-09 01:09:44 -04:00
Brandon Thomas ab0180a591 Update s3 bucket client to respect timeout arg 2022-09-09 00:45:44 -04:00
Brandon Thomas 40e92a1b24 Use no-op Redis status logger optionally 2022-09-08 15:22:52 -04:00
Brandon Thomas bf9bc013df New dynamic job progress reporter with no-op version 2022-09-08 14:56:35 -04:00
Brandon Thomas 4a58f49d3d kill pending jobs 2022-09-04 21:34:50 -04:00
Brandon Thomas da7270e058 Queries to investigate service load, etc. 2022-09-04 19:22:02 -04:00
Brandon Thomas 420a2c8b40 fix gravatar test 2022-09-01 23:49:17 -04:00
Brandon Thomas d1e261e633 no longer fail tests (timebomb bump) 2022-09-01 23:43:31 -04:00
Brandon Thomas bfe4b8d090 Merge pull request #9 from storytold/echelon-billing-and-images
Pull user system into a reusable component library
2022-09-01 23:40:32 -04:00
Brandon Thomas 269145a395 codegen db 2022-09-01 23:38:51 -04:00
Brandon Thomas 22122046ce We're not ready to perform this migrations
I'm being lazy and not pulling the relevant commits out of history
2022-09-01 23:35:43 -04:00
Brandon Thomas 4284aeced6 Substantial refactor: pull user system (except mod controls) into crate
This has been tested in storyteller-web to ensure it still works
2022-09-01 23:33:21 -04:00
Brandon Thomas d047fa50a9 Successfully move one "user" endpoint into new package 2022-09-01 17:25:13 -04:00
Brandon Thomas 273b5f3c4e Move SessionCookieManager to users component 2022-08-29 05:39:00 -04:00
Brandon Thomas 3477cc395b refactor 2022-08-29 04:49:51 -04:00
Brandon Thomas 59f2c4a55d service stub for image-generation-service 2022-08-29 00:56:38 -04:00
Brandon Thomas 84c616b6f6 New lib and service crates 2022-08-29 00:28:26 -04:00
Brandon Thomas 57e3dd05c7 generated image data 2022-08-28 19:52:01 -04:00
Brandon Thomas 2b52488bfa generated images tables 2022-08-25 04:01:50 -04:00
Brandon Thomas 3d2f28431f add credits tables 2022-08-23 13:09:20 -04:00
Brandon Thomas f1c8364b72 First attempt at generic_workloads table 2022-08-23 10:32:09 -04:00
Brandon Thomas bb8ba60829 Initial schema migrations for generated images + billing 2022-08-23 10:07:15 -04:00
Brandon Thomas 50d6537a73 report worker node name, if available 2022-08-18 03:01:06 -04:00
Brandon Thomas e68b6dc72d Merge pull request #8 from storytold/echelon-list-tts-single-connector
Use single connector with list TTS endpoint
2022-08-17 19:42:33 -04:00
Brandon Thomas 1da020abd4 Use single connector with list TTS endpoint 2022-08-17 19:41:30 -04:00
Brandon Thomas db5af2c1f6 Merge pull request #7 from storytold/echelon-more-pooled-connections
Echelon more pooled connections
2022-08-16 21:59:28 -04:00
Brandon Thomas 68fec1c8da leaderboard endpoint now uses connection pool (granted, not great) 2022-08-16 21:58:24 -04:00
Brandon Thomas efe7248ce9 list_tts_model_categories endpoint now uses single connection from pool 2022-08-16 21:29:30 -04:00
Brandon Thomas 6dfe929655 list_tts_categories endpoint now uses single db connection from pool 2022-08-16 21:21:50 -04:00
Brandon Thomas e86612af4b session_info endpoint uses single pooled connection 2022-08-16 21:05:57 -04:00
Brandon Thomas 43f441693e Update get_tts_models to use single pooled connection 2022-08-16 20:52:29 -04:00
Brandon Thomas 0fbc410baf Merge pull request #6 from storytold/echelon-benchmarking
All queries to user profile controller use a single DB connection
2022-08-16 18:58:45 -04:00
Brandon Thomas d393ecda34 All queries to user profile controller use a single DB connection
- Pull a single connection out of the pool and reuse it
- Update the benchmark code to handle ownership changes (previously,
  I think everything was Sync/Send in the closures)
2022-08-16 18:49:25 -04:00
Brandon Thomas 88fb8f65e2 codegen 2022-08-16 02:37:42 -04:00
Brandon Thomas 623913d237 Merge pull request #5 from storytold/echelon-benchmarking
Echelon benchmarking
2022-08-16 02:30:17 -04:00
Brandon Thomas 70daacf559 Profile endpoint instrumented 2022-08-16 02:26:00 -04:00
Brandon Thomas 4bd0e09e7d Move user profile query to query lib 2022-08-16 01:18:47 -04:00
Brandon Thomas 94ed34b5ba Benchmarking library and begin implementation 2022-08-13 02:27:21 -04:00
Brandon Thomas ed3554aeb0 parameterize number of mysql connections 2022-08-11 03:55:46 -04:00
Brandon Thomas 5b2a139da3 forgot to build it 2022-08-10 06:24:53 -04:00
Brandon Thomas 60f38c7f99 Forgot to copy built binary 2022-08-10 05:53:42 -04:00
Brandon Thomas 67b74e98ed DB codegen 2022-08-10 04:44:58 -04:00
Brandon Thomas 2b73e38b15 Merge pull request #4 from storytold/echelon-hifigan-support
Echelon hifigan support
2022-08-10 04:40:18 -04:00
Brandon Thomas 4bc33ffea0 tts-inference-job uses custom vocoder (does not cache) 2022-08-10 04:33:38 -04:00
Brandon Thomas df5e28ec94 query info about vocoders in tts-inference-job 2022-08-10 03:49:15 -04:00
Brandon Thomas 2a10ec5e70 Add custom vocoder info to TTS Model GET endpoint + query 2022-08-10 03:09:16 -04:00
Brandon Thomas 2f360a0475 Update model edit endpoint to include optional vocoder token option 2022-08-10 02:19:49 -04:00
Brandon Thomas f6c33fc2a5 Migration to add vocoder token to TTS models 2022-08-10 02:02:52 -04:00
Brandon Thomas 3835093b51 GET vocoder endpoint 2022-08-10 01:41:15 -04:00
Brandon Thomas 1211262764 vocoder SELECT / get query 2022-08-10 00:57:39 -04:00
Brandon Thomas 419d6bc654 list vocoder endpoint 2022-08-10 00:36:53 -04:00
Brandon Thomas f81b6091b3 queries / endpoints (WIP) 2022-08-09 22:06:36 -04:00
Brandon Thomas 28512b685e Vocoder upload pipeline seems to work! 2022-08-09 22:06:36 -04:00
Brandon Thomas 8696613477 generic-download-job now running (need to test) 2022-08-09 22:06:36 -04:00
Brandon Thomas 962510f784 Fix storyteller-web build 2022-08-09 22:06:36 -04:00
Brandon Thomas 47b7c71cdb WIP generic-download-job 2022-08-09 22:06:36 -04:00
Brandon Thomas dbd7e949b7 WIP generic-download-job 2022-08-09 22:06:36 -04:00
Brandon Thomas 740ba1b2e4 simplify error responses 2022-08-09 22:06:36 -04:00
Brandon Thomas 08c05cbcf2 Schema changes, endpoints, routes, queries, etc. 2022-08-09 22:06:36 -04:00
Brandon Thomas f8175d7666 reusable_types, WIP endpoints 2022-08-09 22:06:36 -04:00
Brandon Thomas 463a7479b9 Generic download job, hifigan model downloads 2022-08-09 22:06:36 -04:00
Brandon Thomas 425c0d3244 Merge branch 'master' of github.com:storytold/storyteller-rust 2022-08-09 22:05:58 -04:00
Brandon Thomas 3c4ef83876 IntelliJ spellcheck 2022-08-09 22:05:32 -04:00
Paul Sajna 53b4272792 Git build sha header (#3) 2022-08-06 00:23:35 -07:00
Brandon Thomas 4ef608720b update readme 2022-08-04 04:40:22 -04:00
Brandon Thomas 078e2eeb9d Mark vendored tests ignored that are failing in CI 2022-08-04 04:35:29 -04:00
Brandon Thomas f837db9a89 Codegen DB for new job crates (post-refactor) 2022-08-04 04:20:56 -04:00
Brandon Thomas bf26f7864f Move last remaining jobs out of storyteller-web and into own crates
- w2l-inference-job
- w2l-download-job

These are now in their own independent crates, which should be easier to
do build caching on.
2022-08-04 04:15:55 -04:00
Brandon Thomas 421b38114c Dockerfile cleanup 2022-08-04 03:44:41 -04:00
Brandon Thomas 174e51d6e1 Run all tests before build 2022-08-04 03:42:27 -04:00
Brandon Thomas a36394238a Fix a few broken tests, but this needs revisiting
- i18n means this module should be rewritten
- is Spanish even being handled correctly?
2022-08-04 03:10:42 -04:00
Brandon Thomas 76933402b5 Fix tests failing to build 2022-08-04 02:17:20 -04:00
Brandon Thomas 6fdd49514e Fix broken vendored crate tests (see notes)
The vendored crate was updated from Tokio 0.2 to 1.0 in ec4816bd0

The tests remained broken.

This fixes the tests and is based in part on

https://github.com/PoiScript/newrelic-telemetry-sdk-rust/commit/f103d56898f599bf0d06e69d3ecc75147aa15d5e#diff-2e9d962a08321605940b5a657135052fbcef87b5e360662bb527c96d9a615542
2022-08-03 16:58:48 -04:00
Brandon Thomas bc2d47ca17 update api token notes 2022-07-28 05:22:48 -04:00
Brandon Thomas 7a9e15d82e Merge branch 'master' of github.com:storytold/storyteller-rust 2022-07-28 04:50:16 -04:00
Brandon Thomas d8b701fe91 api tokens 2022-07-28 04:47:59 -04:00
Brandon Thomas 2490f7029f api tokens 2022-07-28 04:42:52 -04:00
Brandon Thomas db69ca9966 API token updates 2022-07-28 04:38:39 -04:00
Brandon Thomas 136f440f9e API token for James 2022-07-28 04:12:58 -04:00
Brandon Thomas ffcf1f5944 deleted models query 2022-07-28 03:06:26 -04:00
Brandon Thomas fdf8a92cd8 analytics queries 2022-07-28 02:26:12 -04:00
Brandon Thomas c17726ae40 Merge pull request #2 from storytold/debug-worker
ScopedTempDirCreator: this helps span filesystems
2022-07-28 02:10:10 -04:00
Brandon Thomas cf7acace8c ScopedTempDirCreator: this helps span filesystems
TempDir defaults to /tmp. Copies from this to other drives sometimes
fail, which is impeding local development
2022-07-27 23:14:33 -04:00
Brandon Thomas 95f15106f9 Merge pull request #1 from storytold/echelon-obscure-text-pipeline
Echelon obscure text pipeline
2022-07-27 23:12:55 -04:00
Brandon Thomas 2b9cde68e4 Obscure model text_pipeline_type 2022-07-27 23:12:23 -04:00
Brandon Thomas 6d79f91a0a improve comments on text pipelines 2022-07-27 23:12:23 -04:00
Brandon Thomas 7c97e81830 new model analytics query 2022-07-27 03:11:21 -04:00
Brandon Thomas d458d753fb Cache W2L templates in-memory 2022-07-27 02:51:48 -04:00
Brandon Thomas fc88730386 Fix tts job count query 2022-07-25 04:49:36 -04:00
Brandon Thomas 59b9143012 codegen 2022-07-25 02:47:29 -04:00
Brandon Thomas 61dd01e5c2 Add endpoint to expose pending TTS jobs publicly to the UI 2022-07-25 02:44:47 -04:00
Brandon Thomas 101d145709 Query pending TTS job count (public use) 2022-07-25 02:19:30 -04:00
Brandon Thomas 820417ac0f More CORS domains 2022-07-25 01:57:41 -04:00
Brandon Thomas b0cf63d75a API token for 2.2M subs Twitch user IlloJuan 2022-07-15 04:59:21 -04:00
Brandon Thomas 9098ce38d6 Better downloads from Google Buckets. Atomic w/o race conditions. 2022-07-15 04:24:27 -04:00
Brandon Thomas fe529c7088 TTS inference job now health checks the sidecar 2022-07-15 03:32:21 -04:00
Brandon Thomas 5a645b10a2 re-codegen 2022-07-14 20:05:10 -04:00
Brandon Thomas b9fed6a933 Cache model lookups, removing some query load from DB 2022-07-14 20:03:32 -04:00
Brandon Thomas 3ae65f5d11 Add multi-item cache 2022-07-14 19:36:23 -04:00
Brandon Thomas 823cad0900 Cleanup warnings 2022-07-14 19:05:54 -04:00
Brandon Thomas b807adc73d Create "memory_caching" lib crate, start building more tools there 2022-07-14 19:03:22 -04:00
Brandon Thomas 7b07e85191 More cleanup 2022-07-14 18:49:22 -04:00
Brandon Thomas 17f82e78b2 Cleanup: get rid of unused imports in tts-inference-job 2022-07-14 18:45:01 -04:00
Brandon Thomas a09f63537e report how many usages there have been 2022-07-11 04:58:56 -04:00
Brandon Thomas 362e18b7d0 Ugh, path 2022-07-11 03:48:18 -04:00
Brandon Thomas 8edb385728 Add new handlers for design refresh flag cookie installation 2022-07-11 03:26:03 -04:00
Brandon Thomas a04628147b merge related analytics queries into one file 2022-07-11 03:03:19 -04:00
Brandon Thomas ab549ab284 query improvement, fixes 2022-07-10 00:57:03 -04:00
Brandon Thomas 40a88bb04e analytics query 2022-07-09 22:53:31 -04:00
Brandon Thomas d4afc42d5c Index on tts results creation date, query on popular models by date 2022-07-09 13:16:32 -04:00
Brandon Thomas b71278aef1 Push rollout into the future to fix the pronunciation bug
We rolled this out as the default too soon. New models are trained on
10% arpabet only.
2022-07-06 18:55:15 -04:00
Brandon Thomas 39bffb527e analytics queries 2022-07-06 18:51:20 -04:00
Brandon Thomas cfa49edc49 re-codegen 2022-07-06 02:03:24 -04:00
Brandon Thomas b801f7c19e Edit TTS model with text pipeline type 2022-07-06 01:51:08 -04:00
Brandon Thomas f75f55fa22 Use Rust Enum instead 2022-07-06 01:28:08 -04:00
Brandon Thomas 152a2bfad7 Move queries out of edit TTS model handler. 2022-07-06 00:08:36 -04:00
Brandon Thomas 03c6f1a269 Use HTTP inference arg for text_pipeline_type 2022-07-05 21:07:37 -04:00
Brandon Thomas 5a4be7a580 return text_pipeline_type and guess in TTS model GET endpoint 2022-07-05 18:17:19 -04:00
Brandon Thomas 2dd47cab86 Return a new endpoint-specific struct for tts models 2022-07-05 18:03:07 -04:00
Brandon Thomas 8aaa9dfceb utilities for text pipeline determination 2022-07-05 17:52:08 -04:00
Brandon Thomas 46db3980d9 Add new tts_models column for text pipeline type 2022-07-05 16:00:46 -04:00
Brandon Thomas 8d56700860 report debug workers in logs 2022-07-05 02:31:09 -04:00
Brandon Thomas db4c260e08 Fix build error 2022-07-03 23:10:12 -04:00
Brandon Thomas f7880fca97 stop bad tts model download urls from jamming the system 2022-07-03 21:19:45 -04:00
Brandon Thomas b7c7bd7452 Fix codegen (different Rust versions?) and re-codegen db 2022-07-03 20:14:11 -04:00
Brandon Thomas 7a883cdebb Move tts-download-job into its own crate independent of storyteller-web 2022-07-03 20:07:43 -04:00
Brandon Thomas a622e7a9e8 delete by status 2022-06-26 16:56:19 -04:00
Brandon Thomas 0646dbc8f6 cleanup 2022-06-25 11:36:17 -04:00
Brandon Thomas b031e96ef2 Python needed to commit! Ugh! 2022-06-25 11:32:23 -04:00
Brandon Thomas 7c3aa0610a Codegen new queries, fix codegen tool for new binary 2022-06-25 01:22:19 -04:00
Brandon Thomas 4106e4cfe2 Enqueue debug requests 2022-06-25 01:17:46 -04:00
Brandon Thomas 5a584bd6b4 Report tts result debug status 2022-06-25 00:58:07 -04:00
Brandon Thomas ade3162e53 Save debug worker data to tts result record 2022-06-25 00:50:54 -04:00
Brandon Thomas 43824972e5 Worker can now query only debug jobs 2022-06-25 00:31:31 -04:00
Brandon Thomas 6b9e19c4a2 Split up TTS worker to make code easier to maintain 2022-06-25 00:13:46 -04:00
Brandon Thomas 04ba2b2954 minor: before running migrations, move is_debug_request column 2022-06-24 23:46:37 -04:00
Brandon Thomas acfab87b5c show percentage 2022-06-24 23:41:31 -04:00
Brandon Thomas c5b04b51bc debug worker migrations for tts jobs and results
This will let us set jobs to run on "debug" worker nodes.
2022-06-24 22:40:12 -04:00
Brandon Thomas b9b8186e68 Utility to delete old tts_inference_jobs records 2022-06-24 22:00:48 -04:00
Brandon Thomas 78ea11bec0 Fix variable name 2022-06-21 05:33:20 -04:00
Brandon Thomas 46fa940f6d Add clap and sidecar hostname param 2022-06-21 05:23:23 -04:00
Brandon Thomas 853f8c8e6a tts-inference-job didn't need db queries module after all 2022-06-21 05:12:43 -04:00
Brandon Thomas 4f2c43ddaa Pull tts-inference-job into own crate (almost working) 2022-06-21 05:10:05 -04:00
Brandon Thomas a249c6a80e Refactor job dependencies so we can move jobs to their own crates 2022-06-21 04:45:00 -04:00
Brandon Thomas 8e8a87ba51 Refactor CommonEnv into config crate 2022-06-21 03:43:21 -04:00
Brandon Thomas 5a79f20def Move filesystem utils into container_common:: 2022-06-21 03:19:59 -04:00
Brandon Thomas 367dbbb3b2 Disable newrelic flag 2022-06-21 02:46:17 -04:00
Brandon Thomas 7d3d7bc737 Delete cached models to clear up worker filesystems 2022-06-20 22:14:41 -04:00
Brandon Thomas 65cf697cb0 Attempt to enrich "filesystem full" errors for later handling 2022-06-20 21:28:28 -04:00
Brandon Thomas 0b554f0d0f Clarify logging 2022-06-20 17:59:57 -04:00
Brandon Thomas 6b2b868745 Logging for TTS inference job 2022-06-20 17:32:26 -04:00
Brandon Thomas 0d096815f2 Update CORS for staging subdomains 2022-06-18 21:02:54 -04:00
Brandon Thomas 2648688873 codegen db 2022-06-14 00:43:36 -04:00
Brandon Thomas 956e44a452 report worker hostname for tts results 2022-06-14 00:23:05 -04:00
Brandon Thomas 9e1a401a39 TTS job log result token 2022-06-12 15:21:39 -04:00
Brandon Thomas bda2ee592d codegen db 2022-06-12 02:04:28 -04:00
Brandon Thomas d65022a4cf Rename column, track on-prem in worker code 2022-06-12 01:47:39 -04:00
Brandon Thomas 35d6de38d7 Add on-premise metadata columns to tts_results 2022-06-12 01:31:47 -04:00
Brandon Thomas a9e551bea5 Add rate limiter configs for API consumers 2022-06-02 04:55:08 -04:00
Brandon Thomas 789d4b7607 French is officially supported 2022-06-01 17:56:54 -04:00
Brandon Thomas e95e69e2ab Merge branch 'master' of github.com:storytold/storyteller-rust 2022-06-01 15:54:59 -04:00
Brandon Thomas 8792b4c8ae Add logging 2022-06-01 15:54:45 -04:00
Brandon Thomas 508b5467ca Fix dockerfile to remove duplicate nvidia list files 2022-05-31 14:23:00 -04:00
Brandon Thomas 8df2e3c86e fix dockerfile!? 2022-05-31 13:47:48 -04:00
Brandon Thomas b80dc798bb fix? 2022-05-31 13:35:57 -04:00
Brandon Thomas 9cfde5cdaa correct url, distro, arch 2022-05-31 12:58:01 -04:00
Brandon Thomas f0aed0cf5b no sudo 2022-05-31 12:22:49 -04:00
Brandon Thomas 154cb86d0f Fix NVIDIA broken docker packages 2022-05-31 11:47:29 -04:00
Brandon Thomas 7caf85a648 fix typo (ugh) 2022-05-31 11:05:25 -04:00
Brandon Thomas 2ac06d7f0b codegen db 2022-05-31 10:18:30 -04:00
Brandon Thomas 08222f6e7e stupid macbook keeps changing this due to case insensitivity 2022-05-31 10:17:20 -04:00
Brandon Thomas 2ad25bde37 high priority workers (untested, no sql codegen) 2022-05-31 10:15:32 -04:00
Brandon Thomas ceac5c1f59 serde snake_case variants 2022-05-31 09:51:04 -04:00
Brandon Thomas 5bc337de37 API token 2022-05-27 12:13:18 -04:00
Brandon Thomas 3f0b356fd0 Another API token 2022-05-02 00:25:36 -04:00
Brandon Thomas aebc0ffbee add plan details to session endpoint 2022-05-01 23:58:15 -04:00
Brandon Thomas 198f0e6493 Config dir, add static API token (ugh), soon to be stripe configs 2022-04-29 12:17:19 -04:00
Brandon Thomas 784f768cb9 Actually, this token wasn't used/isn't going to be used 2022-04-28 02:47:10 -04:00
Brandon Thomas 65351d4831 API tokens 2022-04-28 02:37:33 -04:00
Brandon Thomas cde1899804 API tokens 2022-04-28 02:13:01 -04:00
Brandon Thomas 9129a8eed2 re-codegen 2022-04-28 00:36:13 -04:00
Brandon Thomas 2cc4a06a10 Add API token note 2022-04-27 23:43:44 -04:00
Brandon Thomas 7234ad3d4b integrate API tokens 2022-04-27 23:28:21 -04:00
Brandon Thomas cb77e94776 Read API tokens from disk 2022-04-27 22:44:38 -04:00
Brandon Thomas 0d3528e18c add common function to deserialize toml since we keep doing this 2022-04-27 17:55:54 -04:00
Brandon Thomas f8bd7fb681 Begin work on statically configured API tokens 2022-04-27 16:37:58 -04:00
Brandon Thomas 70dccbe4fa Merge branch 'master' of github.com:storytold/storyteller-rust 2022-04-27 14:55:33 -04:00
Brandon Thomas 2f6ac39f3e Update README.md 2022-04-22 23:10:31 -04:00
Brandon Thomas 7b4c31e174 update name 2022-04-20 23:59:52 -04:00
Brandon Thomas ceb3f8e559 Update README.md 2022-04-18 23:59:44 -04:00
Brandon Thomas 739363cfe7 Centralize priority level definitions 2022-04-08 04:16:17 -04:00
Brandon Thomas 90c1e1bebf logging cleanup 2022-04-08 03:42:49 -04:00
Brandon Thomas 155294f29e Now things look stable! 2022-04-08 03:15:56 -04:00
Brandon Thomas 2ddeee123f switch to using internal pubsub 2022-04-08 00:05:26 -04:00
Brandon Thomas 2a4236f7aa cleanup redis pubsub, need to work on killing the thread 2022-04-07 23:59:06 -04:00
Brandon Thomas 814de89cbe Async pubsub finally works, and I think I can kill the thread 2022-04-07 23:35:00 -04:00
Brandon Thomas 36d61a999c Killing the pubsub thread works now! 2022-04-07 19:40:54 -04:00
Brandon Thomas 35824b295e Twitch TTS - Websocket thread subscribed to PubSub channel seems to work 2022-04-05 23:29:14 -04:00
Brandon Thomas dfa3cd3074 starting to add new redis pubsub to websocket gateway 2022-04-05 17:22:47 -04:00
Brandon Thomas 6e682b8afe better documentation 2022-04-04 21:28:47 -04:00
Brandon Thomas dcac35f6be Add storyteller.stream to CORS 2022-04-04 19:16:42 -04:00
Brandon Thomas 7cc3f12416 cleanup 2022-04-04 17:57:47 -04:00
Brandon Thomas 09033a3698 simplify informing PubSub service of active browser (share code) 2022-04-04 17:28:00 -04:00
Brandon Thomas 4cd9f63311 Migrations for twitch event timestamps (these were mistakenly omitted) 2022-04-04 01:44:52 -04:00
Brandon Thomas f227978403 ignore temp script with secrets 2022-04-04 01:20:26 -04:00
Brandon Thomas 733dc728db Twitch schema need work - I haven't had time to really dive into this yet 2022-04-04 01:20:04 -04:00
Brandon Thomas f7c804c052 The twitch-websocket-gateway had an old binary referenced 2022-04-04 01:04:28 -04:00
Brandon Thomas 9da04516d3 Merge branch 'merge-more-old-code' 2022-04-04 00:46:35 -04:00
Brandon Thomas f923fda09f Merge and move twitter-vocodes-bot to old_code 2022-04-04 00:44:20 -04:00
Brandon Thomas 664d7c1c1c Merge remote-tracking branch 'old_o/master' into merge-more-old-code 2022-04-04 00:43:26 -04:00
Brandon Thomas df05ced4a7 merge and move discord-vocodes project to old_code/discord-vocodes-bot 2022-04-04 00:42:28 -04:00
Brandon Thomas 399e9aa6f2 Merge remote-tracking branch 'old_n/master' into merge-more-old-code 2022-04-04 00:41:17 -04:00
Brandon Thomas ffc7df6140 Merge and move voder-proxy code into old_code/ 2022-04-04 00:40:12 -04:00
Brandon Thomas 350ec18f1e Merge remote-tracking branch 'old_m/master' into merge-more-old-code 2022-04-04 00:39:15 -04:00
Brandon Thomas d7cf7caf66 Merge and move do-spaces-downloader to old_code/ 2022-04-03 23:59:12 -04:00
Brandon Thomas 8a0c42ac66 Merge remote-tracking branch 'old_l/master' into merge-more-old-code 2022-04-03 23:58:15 -04:00
Brandon Thomas 2113b56154 Merge and move in twitch-tts-desktop-client (which was for unreal) 2022-04-03 23:57:01 -04:00
Brandon Thomas f4e8e0c161 Merge remote-tracking branch 'old_k/master' into merge-more-old-code 2022-04-03 23:55:54 -04:00
Brandon Thomas edf14416e0 Merge and move pubsub-enricher to old_code/pubsub-enricher 2022-04-03 21:30:08 -04:00
Brandon Thomas 51e9ea32eb Merge remote-tracking branch 'old_j/master' into merge-more-old-code 2022-04-03 21:28:56 -04:00
Brandon Thomas 3c22ec5f82 Merge and move old twitch-ingestion-client (for unreal engine) 2022-04-03 21:26:57 -04:00
Brandon Thomas 21d8200c9e Merge remote-tracking branch 'old_i/master' into merge-more-old-code 2022-04-03 21:25:42 -04:00
Brandon Thomas df03f9c35b Merge and move old twitter-ingestion-client (was to be for Unreal) 2022-04-03 21:23:25 -04:00
Brandon Thomas 5040ec8524 Merge remote-tracking branch 'old_h/master' into merge-more-old-code 2022-04-03 21:21:54 -04:00
Brandon Thomas b9669aa7aa Merge in and move old storyteller-protos project (which was for Unreal) 2022-04-03 21:18:54 -04:00
Brandon Thomas d66975abb3 Merge remote-tracking branch 'old_g/master' into merge-more-old-code 2022-04-03 21:17:56 -04:00
Brandon Thomas d7d09ffab5 Change github actions image name 2022-04-03 02:57:35 -04:00
Brandon Thomas 88691cfa2d Move storyteller-web monorepo code back to directory root 2022-04-03 02:55:28 -04:00
Brandon Thomas 8c3f45b677 Move all old code into semantic directory names for easier use 2022-04-03 02:53:51 -04:00
Brandon Thomas d5536ae307 Move old trumped/trumpet repo (it has useful phoneme stuff) to old_f/ 2022-04-03 02:41:35 -04:00
Brandon Thomas 23602137a8 Merge remote-tracking branch 'old_f/master' 2022-04-03 02:39:04 -04:00
Brandon Thomas f94bfa61c0 Notes update 2022-04-03 02:28:05 -04:00
Brandon Thomas ffd0db90e9 move realtime-voice-conversion (once part of voder) to old_e/ 2022-04-03 02:27:09 -04:00
Brandon Thomas e6288e00e9 Merge remote-tracking branch 'old_e/master' 2022-04-03 02:26:14 -04:00
Brandon Thomas 58fa8e6d80 Describe merged code 2022-04-03 02:16:37 -04:00
Brandon Thomas 5326ffa290 Move old voder code (pieces still useful) into old_d 2022-03-31 20:15:36 -04:00
Brandon Thomas b44f1229e2 Merge remote-tracking branch 'old_d/master' 2022-03-31 20:11:13 -04:00
Brandon Thomas d6002cc10a Update merge status 2022-03-31 19:45:12 -04:00
Brandon Thomas 6cb758a12d Move cloudcam (zeromq + UnrealEngine) into old_c 2022-03-31 19:43:25 -04:00
Brandon Thomas a8737ce0ae Merge remote-tracking branch 'old_c/master' 2022-03-31 19:42:15 -04:00
Brandon Thomas 20607c5367 Re-introduce files from bd18ed9c09 2022-03-31 19:41:21 -04:00
Brandon Thomas 61dac586c6 Move cloudcam (green screen visual branch) into old_b/ 2022-03-31 19:39:26 -04:00
Brandon Thomas 497d941746 This is what worked for the YC demo (zmq -> Unreal Engine) 2022-03-31 19:13:40 -04:00
Brandon Thomas 1a2dc43b4c Merge remote-tracking branch 'old_b/green-screen' 2022-03-31 19:10:20 -04:00
Brandon Thomas 25b9bcf997 Instructions for merging 2022-03-28 23:32:37 -04:00
Brandon Thomas 89a3825564 green bg 2022-03-26 19:57:09 -04:00
Brandon Thomas b89be75ab6 Move old storyteller-web project into new subdir 2022-03-26 19:32:02 -04:00
Brandon Thomas 7ebb3382d3 Merge remote-tracking branch 'old_a/master'
Following https://stackoverflow.com/a/14470212
2022-03-26 19:26:15 -04:00
Brandon Thomas d68aae99f2 merging repositories and histories 2022-03-26 19:18:43 -04:00
Brandon Thomas ef7227509e add token 2022-03-25 23:33:57 -04:00
Brandon Thomas 4a72295eee Add path to cookie 2022-03-23 22:54:04 -04:00
Brandon Thomas 340bedbcee bah, wrong cookie domain 2022-03-23 19:06:23 -04:00
Brandon Thomas 732ade7540 Set cookie domain explicitly 2022-03-23 19:02:43 -04:00
Brandon Thomas ff2bc5e4fa Merge branch 'master' of github.com:storytold/storyteller-web 2022-03-23 12:25:54 -04:00
Brandon Thomas 67df72d669 http GET 2022-03-23 10:29:28 -04:00
Brandon Thomas fa684466b2 new redirect url 2022-03-23 10:27:14 -04:00
Brandon Thomas da8df046fe more build errors, seriously wtf 2022-03-22 15:57:29 -04:00
Brandon Thomas 836536226f fix build error with safe redirects (would have caught if mac not dumb) 2022-03-22 15:26:49 -04:00
Brandon Thomas 07923bb34f twitch event logs schema wip 2022-03-21 23:55:59 -04:00
Brandon Thomas 4868d206af this works! 2022-03-20 05:05:15 -04:00
Brandon Thomas fcdee8628e wip 2022-03-20 04:47:28 -04:00
Brandon Thomas aa7d1906a9 partial fixes to ancient code 2022-03-20 04:25:28 -04:00
Brandon Thomas 838934880f builder didn't match impl 2022-03-18 06:39:08 -04:00
Brandon Thomas 74d7f3c276 Investor mode: priority, cookie to enable 2022-03-18 06:02:42 -04:00
Brandon Thomas f313d825de Merge branch 'master' of github.com:storytold/storyteller-web 2022-03-18 05:28:27 -04:00
Brandon Thomas c573a923b4 Add analytics queries 2022-03-15 23:56:04 -04:00
Brandon Thomas db7e770513 begin work on logging schema for twitch 2022-03-13 23:58:04 -04:00
Brandon Thomas 8c1bf07a19 Merge branch 'master' of github.com:storytold/storyteller-web 2022-03-13 23:51:06 -04:00
Brandon Thomas bd8ca1c831 Readme update 2022-03-12 20:57:22 -05:00
Brandon Thomas 0b9818cbcb Updated instructions since unpacking this after 6 months didn't work 2022-03-12 17:23:10 -05:00
Brandon Thomas 86cd30e134 Update README.md 2022-03-11 23:58:03 -05:00
Brandon Thomas 3d696b71ee Add two new EventResponse types: TtsCommandPreset, TtsCommandCustom 2022-03-10 23:37:36 -05:00
Brandon Thomas c7fa4b65bc document how to make CSV reports 2022-03-06 07:02:18 -05:00
Brandon Thomas 4734d20690 category list caching 2022-03-06 05:42:28 -05:00
Brandon Thomas 8d6a384ac7 health check query 2022-03-06 05:21:12 -05:00
Brandon Thomas 30929b051e add health checking 2022-03-06 05:18:15 -05:00
Brandon Thomas efe2bcd61d rename fields correctly 2022-03-05 06:00:47 -05:00
Brandon Thomas d7205ea3af add more slurs. Thanks to bibby 2022-03-05 04:54:39 -05:00
Brandon Thomas 61ee753572 endpoint to kill running queries 2022-03-05 04:50:29 -05:00
Brandon Thomas 847805624e more stats about jobs 2022-03-05 04:16:58 -05:00
Brandon Thomas e945772c6a codegen db 2022-03-03 03:00:35 -05:00
Brandon Thomas e9b1a4ca8f priority levels 2022-03-03 02:49:13 -05:00
Brandon Thomas 2f17465a84 job sorts by priority during, but has starvation prevention + env config 2022-03-03 02:00:32 -05:00
Brandon Thomas 1730da9caa Multiple tiers of rate limiting 2022-03-03 01:12:50 -05:00
Brandon Thomas 95dc7617ff minor stuff related to rate limit 2022-03-03 00:29:58 -05:00
Brandon Thomas 030b126a9c tests around LFU 2022-03-02 20:32:09 -05:00
Brandon Thomas 91eae38e3b aughhh usize 2022-03-02 19:45:55 -05:00
Brandon Thomas 95617e9c0c max lfu models not used! 2022-03-02 19:32:05 -05:00
Brandon Thomas f069d9e1f3 fix rules not applying! 2022-03-02 07:29:02 -05:00
Brandon Thomas 78efb11dbd return username in oauth check 2022-03-02 06:54:43 -05:00
Brandon Thomas 9e55283b86 codegendb 2022-03-02 06:29:39 -05:00
Brandon Thomas d2cc56940c change oauth routes 2022-03-02 06:27:57 -05:00
Brandon Thomas 09cd602839 check oauth token existence 2022-03-02 06:20:10 -05:00
Brandon Thomas 5dfe83fe0f add oauth token internal pk 2022-03-02 05:32:20 -05:00
Brandon Thomas 9dcc7665ff Add internal token (dangerous, unsupported) 2022-03-02 05:17:06 -05:00
Brandon Thomas e96b58afca change default language from en-US to en 2022-03-01 07:05:16 -05:00
Brandon Thomas b049450d35 codegen 2022-03-01 06:04:55 -05:00
Brandon Thomas 115aff8855 edit language tags, tts command 2022-03-01 05:47:03 -05:00
Brandon Thomas 252f0e1134 supported language tools 2022-03-01 05:13:27 -05:00
Brandon Thomas a976d3e84d add to another endpoint (get) 2022-03-01 04:32:13 -05:00
Brandon Thomas 41d5526c50 return new fields in list 2022-03-01 04:26:57 -05:00
Brandon Thomas 26bbbc412b migrations for new columns: langauge, tts command 2022-03-01 04:06:33 -05:00
Brandon Thomas e571c36f78 logging 2022-02-27 08:29:54 -05:00
Brandon Thomas 283a851a17 COOOORRRRS 2022-02-27 08:06:39 -05:00
Brandon Thomas 7b7417ae14 cors, nginx (still not working) 2022-02-27 06:37:40 -05:00
Brandon Thomas c44dc209b3 more cors 2022-02-27 05:22:56 -05:00
Brandon Thomas 1ca99bdcaf codegen db 2022-02-26 20:48:23 -05:00
Brandon Thomas 7a77207275 sort by rule order 2022-02-26 20:46:40 -05:00
Brandon Thomas 9633e7515a fixed up, because upsert fails for rquired key 2022-02-26 06:38:55 -05:00
Brandon Thomas e738d147e4 handler for reorder rules (untested) 2022-02-26 05:50:50 -05:00
Brandon Thomas dfe902de4b Begin work on "rule reorder", plus tests for unsafe query 2022-02-26 05:29:35 -05:00
Brandon Thomas 9b54e5b4be validation of predicates and responses 2022-02-25 20:43:34 -05:00
Brandon Thomas 7e294d77d7 remove rule order from edit event (since this is awkward in isolation) 2022-02-25 20:29:17 -05:00
Brandon Thomas 65c821e394 bugfix 2022-02-25 04:26:35 -05:00
Brandon Thomas bf97de31e0 more structured testing 2022-02-24 23:42:18 -05:00
Brandon Thomas 8ca4264afd testing 2022-02-24 23:32:28 -05:00
Brandon Thomas eff693692b test data 2022-02-24 05:22:55 -05:00
Brandon Thomas c4e1241966 better test data 2022-02-22 14:58:12 -05:00
Brandon Thomas b237fe0f48 url fix, DELETE CORS 2022-02-22 05:25:04 -05:00
Brandon Thomas 75c9c2a00d new "get" endpoint, changed URLs 2022-02-22 04:43:02 -05:00
Brandon Thomas e517b393cf test data 2022-02-22 03:26:18 -05:00
Brandon Thomas b0df0a0e4f fix event response serialization, make use of test script 2022-02-22 01:10:56 -05:00
Brandon Thomas 40a83e1bad propagate type updates 2022-02-22 00:44:58 -05:00
Brandon Thomas b59d7af915 EventResponse::NotSet also needs to be empty enum for proper json 2022-02-22 00:26:14 -05:00
Brandon Thomas 2c390ca20a had to adjust "NotSet" enum for serialization 2022-02-22 00:16:26 -05:00
Brandon Thomas c6fb2716fa handle channel points events 2022-02-21 22:10:07 -05:00
Brandon Thomas 937f9d86a4 rule matching is much more robust 2022-02-21 17:40:56 -05:00
Brandon Thomas 38deee044f mut cleanup 2022-02-21 15:30:26 -05:00
Brandon Thomas 4b0cd9c197 mut fixup 2022-02-21 15:27:40 -05:00
Brandon Thomas ee387ce314 wip handlers (broken) 2022-02-21 04:00:48 -05:00
Brandon Thomas 480a2dc216 thread refactor 2022-02-21 00:00:01 -05:00
Brandon Thomas 844db3f6a8 split obs-gateway into websocket-gateway and twitch-pubsub-... 2022-02-20 23:31:09 -05:00
Brandon Thomas 8d2aad48aa necessary for local dev 2022-02-20 20:05:41 -05:00
Brandon Thomas bee4f25e2d Local Dev SSL instructions for Linux (they work!) 2022-02-20 04:00:39 -05:00
Brandon Thomas e47222ac29 add user token to twitch oauth (untested, stupid ssl) 2022-02-20 03:47:38 -05:00
Brandon Thomas 78623265df query website settings from twitch job 2022-02-20 03:25:55 -05:00
Brandon Thomas 5a51a0ca39 hydrate on list too 2022-02-19 23:54:07 -05:00
Brandon Thomas b726898119 comnplex types 2022-02-19 23:43:24 -05:00
Brandon Thomas 83aced2181 use complex types 2022-02-19 23:35:59 -05:00
Brandon Thomas f1a9def628 event response and predicate 2022-02-19 22:34:59 -05:00
Brandon Thomas 8931c7175a wip "complex models" 2022-02-19 14:18:30 -05:00
Brandon Thomas 361bfed6d6 re-codegen db 2022-02-19 13:50:40 -05:00
Brandon Thomas e6f0908a3d voice clone requests endpoints 2022-02-19 13:48:36 -05:00
Brandon Thomas 9280ec11f7 fix endpoint, debug script 2022-02-19 05:33:31 -05:00
Brandon Thomas 8e0a21421b twitch event rule endpoints 2022-02-19 05:19:56 -05:00
Brandon Thomas 867e1c0ed5 huge re-codegen 2022-02-19 04:34:23 -05:00
Brandon Thomas 420a706f5d massive in-library refactor 2022-02-19 04:03:45 -05:00
Brandon Thomas c4b8e0912a finally done of in-app 'database' module 2022-02-19 03:42:39 -05:00
Brandon Thomas 598e99d2da refactor- almost done 2022-02-19 03:15:10 -05:00
Brandon Thomas 20a6839eaf more refactor into mysql module 2022-02-19 02:45:41 -05:00
Brandon Thomas c9b2d3ea10 continued refactor of db queries into lib 2022-02-19 02:25:11 -05:00
Brandon Thomas 8854366c12 more refactor into common lib 2022-02-19 02:05:43 -05:00
Brandon Thomas 17ff619f79 continued refactor into database_queries lib 2022-02-19 01:52:55 -05:00
Brandon Thomas a468795294 more refactoring, getting rid of old enums 2022-02-19 01:32:39 -05:00
Brandon Thomas bea8376066 more refactor 2022-02-19 01:23:55 -05:00
Brandon Thomas fd272a853a refactor: get rid of in-app database::enums module 2022-02-19 01:05:05 -05:00
Brandon Thomas 93c5ec0257 move w2l stats query 2022-02-19 00:36:35 -05:00
Brandon Thomas e2c645a17c Refactor: move rest of TTS queries into tts library crate 2022-02-19 00:31:40 -05:00
Brandon Thomas 30b484a92d cleanup of in-app i8_to_bool, some derive_more, etc. 2022-02-18 21:53:25 -05:00
Brandon Thomas 0d3faf230d make two queries a little more obvious 2022-02-18 20:54:11 -05:00
Brandon Thomas 62eff2ec82 query by user token 2022-02-18 20:51:40 -05:00
Brandon Thomas 71e8da44bf queries for voice clone request insert / fetch 2022-02-18 20:47:56 -05:00
Brandon Thomas 6a4e967a70 Table for cloning voices 2022-02-18 20:08:42 -05:00
Brandon Thomas de0bd9f09d rule_is_enabled --> rule_is_disabled 2022-02-18 19:21:50 -05:00
Brandon Thomas 5b7d533dc3 cleanup 2022-02-18 19:17:21 -05:00
Brandon Thomas cdc04b66d7 get twitch event rule for user 2022-02-18 19:14:24 -05:00
Brandon Thomas 1c3dbbe779 list twitch event categories 2022-02-18 19:02:29 -05:00
Brandon Thomas 416c32d166 update twitch event rule 2022-02-18 18:48:41 -05:00
Brandon Thomas 73de5d185c Add API token internal token as foreign key 2022-02-18 18:34:27 -05:00
Brandon Thomas d9039b9071 cleanup some compile warnings 2022-02-18 18:26:34 -05:00
Brandon Thomas dcde6edba4 delete twitch event rule 2022-02-18 17:17:46 -05:00
Brandon Thomas da6cbd5cfa insert Twitch event rule 2022-02-18 17:02:55 -05:00
Brandon Thomas ba1e61a78e rename *again*, sort columns 2022-02-18 02:46:48 -05:00
Brandon Thomas 43160dd9e6 rename migration 2022-02-18 02:43:03 -05:00
Brandon Thomas 4b5c41e67d add ip address columns 2022-02-18 00:38:40 -05:00
Brandon Thomas 05edf16847 update twitch tables with timestamp columns 2022-02-18 00:36:50 -05:00
Brandon Thomas cb3c91f802 delete api token endpoint 2022-02-18 00:04:01 -05:00
Brandon Thomas 54ca8d4c7a edit API token handler 2022-02-17 23:33:06 -05:00
Brandon Thomas 56ac627c4a move vendor/ to crates/vendor 2022-02-17 21:54:54 -05:00
Brandon Thomas b642a9a031 re-codegen 2022-02-17 05:10:42 -05:00
Brandon Thomas 84bbd3e2ca Fix Gdown / Google Drive issue? 2022-02-17 04:46:34 -05:00
Brandon Thomas 0a3b99fc70 debug creation of API tokens 2022-02-16 04:13:59 -05:00
Brandon Thomas 653c282f07 API tokens migration, queries, and handlers (list, create) 2022-02-16 03:59:38 -05:00
Brandon Thomas 23e6f552e7 migrations for api tokens 2022-02-16 02:41:02 -05:00
Brandon Thomas 0507488ae1 index page update with microservice name (for local dev) + discord link 2022-02-13 21:35:41 -05:00
Brandon Thomas 64da009acb Local dev configs for nginx (untested) 2022-02-13 21:24:52 -05:00
Brandon Thomas 70b6d1aa34 disable rule 2022-02-13 19:23:56 -05:00
Brandon Thomas fed4bac5de database connect (local dev) 2022-02-13 19:20:38 -05:00
Brandon Thomas 3528359d74 Twitch user configs (first iteration) 2022-02-13 19:20:23 -05:00
Brandon Thomas e2eb288fa8 no more badge 2022-02-13 11:36:19 -05:00
Brandon Thomas 2a885c7758 cleanup a lot of unused imports that warned 2022-02-11 10:55:09 -05:00
Brandon Thomas 5df2416524 re-codegen db after new cols and refactors 2022-02-11 10:48:40 -05:00
Brandon Thomas 79e61b44af edit featured tts model status 2022-02-11 10:47:28 -05:00
Brandon Thomas 701c0139f9 move query to db lib 2022-02-11 10:41:00 -05:00
Brandon Thomas dd9733f9a8 Add featured TTS models (not yet done) + refactoring 2022-02-11 10:18:24 -05:00
Brandon Thomas cf11c115f9 add raw inference text to inference job status 2022-02-11 07:45:07 -05:00
Brandon Thomas 0d52e96307 re-codegen 2022-02-10 23:40:01 -05:00
Brandon Thomas 262024ec28 Insert twitch and priority metadata 2022-02-10 23:25:55 -05:00
Brandon Thomas 93c8507386 error reporting 2022-02-10 23:12:56 -05:00
Brandon Thomas 6c131e2da1 additional cors for dev, fix twitch cheer case sensitivity 2022-02-10 03:14:20 -05:00
Brandon Thomas cd297c1b36 note on linux issue 2022-02-10 02:08:08 -05:00
Brandon Thomas c488773bc1 re-codegen db 2022-02-10 01:03:47 -05:00
Brandon Thomas bf4e000644 Huge refactor of TTS job queries into database_queries common lib 2022-02-10 00:52:46 -05:00
Brandon Thomas 0fddc08868 Make Status an enum 2022-02-09 13:43:22 -05:00
Brandon Thomas 7394667f4a begin moving these to database_queries crate 2022-02-09 13:34:09 -05:00
Brandon Thomas 765ecfb1db a few more reservations 2022-02-09 12:42:46 -05:00
Brandon Thomas 67f93b84ac add priority level to tts 2022-02-09 12:30:39 -05:00
Brandon Thomas 29f713c157 tts migrations with source metadata 2022-02-08 23:39:45 -05:00
Brandon Thomas 8f25491e78 Add language detection endpoint 2022-02-07 05:12:25 -05:00
Brandon Thomas aa43554013 remove non-ASCII entirely 2022-02-07 01:20:26 -05:00
Brandon Thomas 820ac51190 add some emoji 2022-02-07 00:52:17 -05:00
Brandon Thomas 169739d617 comments 2022-02-07 00:23:46 -05:00
Brandon Thomas 3eb23cc3d7 more cleanup 2022-02-07 00:16:05 -05:00
Brandon Thomas 3cba684ddc handle 5k occurrences 2022-02-07 00:06:45 -05:00
Brandon Thomas cd70d7b06f more buckets 2022-02-06 23:54:54 -05:00
Brandon Thomas 343f8a5b2b split tests a bit 2022-02-06 23:52:25 -05:00
Brandon Thomas 7313a0d180 more conversions (hardly done) 2022-02-06 23:49:04 -05:00
Brandon Thomas 5cfde7b0f2 add more of latin extended-a 2022-02-06 23:16:46 -05:00
Brandon Thomas 26cabf3407 new tests (most failing) 2022-02-06 23:08:07 -05:00
Brandon Thomas a1162d1e86 cleanup for legibility 2022-02-06 22:27:53 -05:00
Brandon Thomas 2cc117b04f tests 2022-02-06 21:16:21 -05:00
Brandon Thomas 4e9919f5a2 more things to remove 2022-02-06 20:19:36 -05:00
Brandon Thomas f0ea7be729 more characters to convert 2022-02-06 20:06:35 -05:00
Brandon Thomas 65db6a1041 table is simpler to read 2022-02-06 19:47:44 -05:00
Brandon Thomas 8b02351517 Share latin-to-ascii code/map 2022-02-06 19:38:57 -05:00
Brandon Thomas a50554d4b7 More slurs to ban 2022-02-06 19:28:56 -05:00
Brandon Thomas e56ac834ee ban slurs with latin characters and upper case 2022-02-06 19:21:49 -05:00
Brandon Thomas c25639baa4 Create user_input_common shared lib crate 2022-02-06 19:04:08 -05:00
Brandon Thomas 4e8c736814 forgot a few references to raw text 2022-02-06 17:52:46 -05:00
Brandon Thomas ec4816bd00 Upgrade vendored newrelic-telemetry-sdk tokio 0.2 -> 1.0 2022-02-06 15:16:23 -05:00
Brandon Thomas 538568e963 more code points to convert 2022-02-06 02:05:34 -05:00
Brandon Thomas d6097b66c3 more spanish characters 2022-02-06 00:22:41 -05:00
Brandon Thomas fd589f85e8 latin tests 2022-02-06 00:04:31 -05:00
Brandon Thomas ee6631f432 latin letters 2022-02-05 23:52:34 -05:00
Brandon Thomas 3df44a8d51 more characters to convert 2022-02-05 23:36:54 -05:00
Brandon Thomas ee7634b9d0 unicode literals 2022-02-05 23:33:21 -05:00
Brandon Thomas 794010df9c ellipsis 2022-02-05 23:14:28 -05:00
Brandon Thomas b800ace754 fix tts inference for smart quotes 2022-02-05 23:03:51 -05:00
Brandon Thomas 0c29c4133e a few more tests 2022-02-05 22:58:55 -05:00
Brandon Thomas fa5c88ea1e en dash / em dash 2022-02-05 22:56:21 -05:00
Brandon Thomas 75461a49df new small crate to get rid of smart quotes, etc 2022-02-05 22:40:04 -05:00
Brandon Thomas aa59e05d5b optional serialization 2022-02-05 21:30:32 -05:00
Brandon Thomas 916a3f8abf send pong 2022-02-04 10:21:27 -05:00
Brandon Thomas 8494a6c816 more debug logging 2022-02-03 22:58:09 -05:00
Brandon Thomas f2e740133a Fix redis panic (why is it okay in dev??) 2022-02-03 07:10:45 -05:00
Brandon Thomas 6c04d35ef1 add oauth grouping token last minute 2022-02-03 04:51:12 -05:00
Brandon Thomas 7cbede9d3d re-codegen 2022-02-03 03:36:22 -05:00
Brandon Thomas 89ee7f6606 cleanup 2022-02-03 03:35:04 -05:00
Brandon Thomas e5cd8164c3 fix URLs 2022-02-03 03:24:10 -05:00
Brandon Thomas 05db14bfbd fixup query errors, add second redirect url 2022-02-03 03:13:30 -05:00
Brandon Thomas 9693bf7704 add all oauth scopes to mysql (untested, kind of dumb) 2022-02-03 02:48:50 -05:00
Brandon Thomas 24701aa9a8 Move Twitch OAuth onboarding to storyteller-web 2022-02-03 00:38:40 -05:00
Brandon Thomas c30fbfbf82 SQLX db codegen / cache failed (??), this should fix it 2022-01-31 22:43:50 -05:00
Brandon Thomas c6656aa417 Send to frontend 2022-01-31 16:53:37 -05:00
Brandon Thomas 2308d5f5d2 twitch secrets from env 2022-01-31 06:29:55 -05:00
Brandon Thomas 4b1aad995d CORS: api.fakeyou.com 2022-01-31 06:20:06 -05:00
Brandon Thomas 1ed43fb510 codegen db 2022-01-31 06:15:12 -05:00
Brandon Thomas 7563f48f05 job token 2022-01-31 04:51:03 -05:00
Brandon Thomas 39ab109f19 move tokens::Tokens util for MySql to common lib crate 2022-01-31 04:45:25 -05:00
Brandon Thomas 69186282a0 inserts pending job 2022-01-31 04:36:26 -05:00
Brandon Thomas 99b642f7ac insert tts job records (wip) 2022-01-31 04:24:17 -05:00
Brandon Thomas 1b5c3f6b3f trim spaces 2022-01-31 03:43:52 -05:00
Brandon Thomas 313950f7b3 remove cheers from text 2022-01-31 03:25:23 -05:00
Brandon Thomas db582ca7e7 Add twitch_common crate 2022-01-31 03:04:12 -05:00
Brandon Thomas e363f90eba Add new binaries to Dockerfile 2022-01-31 02:20:31 -05:00
Brandon Thomas 6cbcd7354c codegen db 2022-01-31 02:02:28 -05:00
Brandon Thomas 3dbc1890da fixup bugs 2022-01-31 02:01:54 -05:00
Brandon Thomas 6445244957 save both event types to db 2022-01-31 01:53:27 -05:00
Brandon Thomas da5c1893b3 record channel bits event 2022-01-31 01:39:16 -05:00
Brandon Thomas 37851f8f53 channel points inserts 2022-01-31 00:46:44 -05:00
Brandon Thomas 3f889c6aad adjust inserts 2022-01-30 14:14:31 -05:00
Brandon Thomas 4448a81ee5 insert bits (untested) 2022-01-30 03:51:53 -05:00
Brandon Thomas 6d6c7bc923 more schema 2022-01-30 02:11:27 -05:00
Brandon Thomas e49f6f66df migrations wip 2022-01-30 00:11:17 -05:00
Brandon Thomas 30d96a94c5 start adding docs 2022-01-29 23:49:03 -05:00
Brandon Thomas 103d9108b1 cheating on git commits again, hopefully the last time 2022-01-28 23:42:18 -05:00
Brandon Thomas 115fc2fe70 I'm cheating here... 2022-01-27 23:58:06 -05:00
Brandon Thomas 7f4cb37aea schema wip 2022-01-26 23:32:32 -05:00
Brandon Thomas ec67c123d2 empty migrations for bits/channel points 2022-01-25 23:57:38 -05:00
Brandon Thomas 9a05b91788 more notes 2022-01-25 04:16:14 -05:00
Brandon Thomas 80da30937e channel points message 2022-01-25 03:48:05 -05:00
Brandon Thomas 427c1d2761 message with bits 2022-01-25 03:43:36 -05:00
Brandon Thomas 0edcf2b9c1 Fix refresh count 2022-01-24 18:32:46 -05:00
Brandon Thomas 228e312949 Add refresh_count to model 2022-01-24 00:50:22 -05:00
Brandon Thomas 2ed75e5b0f cleanup 2022-01-24 00:34:47 -05:00
Brandon Thomas 2d9fa3bd2f oauth renewal works 2022-01-24 00:34:02 -05:00
Brandon Thomas 7a23cb69fa simpler without optionals 2022-01-24 00:23:21 -05:00
Brandon Thomas aa8f483da0 error handling 2022-01-24 00:17:43 -05:00
Brandon Thomas 92b31bc2c5 this nonsense helps my poor ADHD 2022-01-23 23:57:26 -05:00
Brandon Thomas 245b3397a8 change order 2022-01-23 23:55:17 -05:00
Brandon Thomas c86d8f81d3 cleanup (this might be a regression) 2022-01-23 20:33:03 -05:00
Brandon Thomas 95ef47459f Token renewal, but broken. Need to reinit pubsub 2022-01-23 17:25:21 -05:00
Brandon Thomas 26f42889bf plumb token refresher 2022-01-23 02:30:07 -05:00
Brandon Thomas ca38a5d69d add refresh token tool 2022-01-23 01:57:53 -05:00
Brandon Thomas 07b480ef26 begin work on token renewal 2022-01-23 00:59:37 -05:00
Brandon Thomas 1bff8de1a5 kill thread when OBS session goes away 2022-01-22 17:14:23 -05:00
Brandon Thomas a9dbc7303c cleanup 2022-01-21 23:43:51 -05:00
Brandon Thomas 2011f31e70 Check lease for expiry 2022-01-21 10:32:33 -05:00
Brandon Thomas d4e90b9ec8 docs, logging 2022-01-21 10:11:09 -05:00
Brandon Thomas dc3d3cc24a update main thread to struct 2022-01-21 10:00:15 -05:00
Brandon Thomas 51f6e8229f thread id stuff 2022-01-21 09:51:47 -05:00
Brandon Thomas 795f1a7b45 cleanup 2022-01-21 00:19:29 -05:00
Brandon Thomas 516eb12ecd HOW DID THIS GET COMMITTED 2022-01-20 23:49:36 -05:00
Brandon Thomas 72b6924422 fix blocking behavior!! 2022-01-20 23:48:33 -05:00
Brandon Thomas 6950a86821 better, but gets stuck / blocking 2022-01-20 22:07:52 -05:00
Brandon Thomas 7e875f6b37 much cleaner thread, but redis lease doesn't get renewed 2022-01-20 22:03:06 -05:00
Brandon Thomas ebda0d9317 threads as structs 2022-01-20 21:24:31 -05:00
Brandon Thomas 5647cacfa9 wip 2022-01-19 23:51:57 -05:00
Brandon Thomas 1ec18e5daa cleanup 2022-01-18 23:11:22 -05:00
Brandon Thomas 7bc698482c more cleanup 2022-01-18 23:02:04 -05:00
Brandon Thomas 035acf62c5 less type juggling 2022-01-18 22:57:55 -05:00
Brandon Thomas 0cb8cbd802 store lowercase twitch username 2022-01-18 22:42:05 -05:00
Brandon Thomas ab90af892f misc 2022-01-18 21:47:00 -05:00
Brandon Thomas d83fbb993e got cheer !!! 2022-01-18 00:22:57 -05:00
Brandon Thomas 52785debf7 more pubsub 2022-01-17 23:58:06 -05:00
Brandon Thomas 46b688aa28 more 2022-01-17 23:30:00 -05:00
Brandon Thomas 7a9f747d7d leasing (WIP) 2022-01-17 21:15:05 -05:00
Brandon Thomas 5f66017fb7 more work towards threading, redis messaging 2022-01-17 15:20:05 -05:00
Brandon Thomas ffe86adc60 this threading paradigm should work! 2022-01-16 19:18:41 -05:00
Brandon Thomas 446dd31f81 redis pubsub works! 2022-01-16 18:59:55 -05:00
Brandon Thomas 698c052036 background thread (won't ctrl-c) 2022-01-16 18:42:36 -05:00
Brandon Thomas 76ef8be03f cleanup 2022-01-16 18:31:23 -05:00
Brandon Thomas 4af8aeee5b publish session active events 2022-01-16 18:20:51 -05:00
Brandon Thomas e489d7f245 json test 2022-01-16 17:19:25 -05:00
Brandon Thomas 713fc6bd1c make redis_common lib crate to contain centralized Redis keys, etc. 2022-01-16 17:07:09 -05:00
Brandon Thomas c0e9fe7d0e update dockerfile 2022-01-16 11:09:12 -05:00
Brandon Thomas 85f27e603f Move migrations directories to sort first, needs PATCHED diesel-cli 2022-01-16 11:07:59 -05:00
Brandon Thomas c0833bb69a Docs on Redis schema 2022-01-16 10:42:17 -05:00
Brandon Thomas 277cb36c85 cleanup websocket 2022-01-16 10:14:31 -05:00
Brandon Thomas 37331f685a fix twitch query, add common error library code 2022-01-16 10:06:30 -05:00
Brandon Thomas 8f8a3e44f3 Two Redis indices. Twitch/OBS will be on n=1
This will require updating deployment yamls.
2022-01-15 14:22:37 -05:00
Brandon Thomas 1343ab2de1 move docs to top 2022-01-15 11:40:58 -05:00
Brandon Thomas c4f42cb4f9 update to make username mandatory field 2022-01-15 11:38:40 -05:00
Brandon Thomas c8bfb1f2f0 codegen db 2022-01-12 01:42:53 -05:00
Brandon Thomas 0a27c79ee3 handle more fields 2022-01-12 01:36:42 -05:00
Brandon Thomas 322d957105 persist twitch tokens to db! woo! 2022-01-12 01:27:47 -05:00
Brandon Thomas 38d58cf0c7 WIP: sqlx / actix version mismatch 2022-01-12 00:59:28 -05:00
Brandon Thomas fdaa4a2eef fix queries 2022-01-12 00:17:08 -05:00
Brandon Thomas 405834f2d6 "find" builder (not yet working) 2022-01-12 00:05:26 -05:00
Brandon Thomas ee5d4be0a6 add ip address at creation 2022-01-11 22:23:53 -05:00
Brandon Thomas 86953af7c2 new shared lib crate for db queries, insert into oauth tokens 2022-01-11 22:18:40 -05:00
Brandon Thomas 367595f4e8 work on twitch database table schema 2022-01-11 21:14:51 -05:00
Brandon Thomas 902ae9e5be Split up documentation across multiple files 2022-01-11 20:17:17 -05:00
Brandon Thomas c3e3bf8ef8 this appears to work 2022-01-11 00:43:07 -05:00
Brandon Thomas 95486d659a new design idea: separate job to handle polling 2022-01-11 00:42:00 -05:00
Brandon Thomas f05eb2589a ugh, this is not working 2022-01-10 20:21:00 -05:00
Brandon Thomas 20c5a9578a this compiles! does it work? 2022-01-10 19:06:16 -05:00
Brandon Thomas 40fdb3d2ac WIP (not building) 2022-01-10 18:58:46 -05:00
Brandon Thomas 5907ba7aa6 async blocks 2022-01-10 05:05:50 -05:00
Brandon Thomas fd9cfc159b refactor 2022-01-10 04:39:02 -05:00
Brandon Thomas 22cf399f5c more refactor 2022-01-10 04:24:04 -05:00
Brandon Thomas 7aa33d19b0 refactor 2022-01-10 03:33:23 -05:00
Brandon Thomas d29286a164 simplify - polling client is too much 2022-01-10 03:19:30 -05:00
Brandon Thomas f7bf44f64c proved we can have multiple threads now
Old setup was blocking, must have executed on the same runtime thread

Need a way to prevent people from spinning up multiple threads.
2022-01-10 02:37:25 -05:00
Brandon Thomas d77f723c98 move a few more utilities to common code (tokens, uuids) 2022-01-10 02:33:51 -05:00
Brandon Thomas a6855f5b80 start using container shared lib 2022-01-10 02:12:38 -05:00
Brandon Thomas 380b5d62a3 sort shared library directory tree before app code 2022-01-10 01:52:44 -05:00
Brandon Thomas 8500c2d888 this seems to work ? 2022-01-09 21:32:03 -05:00
Brandon Thomas 6b03fb84c5 OBS WIP 2022-01-09 21:14:15 -05:00
Brandon Thomas cb5a135f68 trying to figure out websocket stuff again 2022-01-09 02:57:20 -05:00
Brandon Thomas e9fd96cd4b OBS 2022-01-09 01:32:26 -05:00
Brandon Thomas aad92d7295 CORS for storyteller.io 2022-01-08 02:43:32 -05:00
Brandon Thomas 00036b0b5d proper setup for local dev + optional ssl 2022-01-07 16:56:49 -05:00
Brandon Thomas eb028fe561 Filter out deleted category assignments 2022-01-07 02:59:29 -05:00
Brandon Thomas dc1fc75c2d simplify readme 2022-01-07 02:37:25 -05:00
Brandon Thomas df7283a407 storyteller ssl nginx configs + plain http 2022-01-07 02:35:37 -05:00
Brandon Thomas 1f41401660 add SSL version of nginx configs 2022-01-07 02:30:29 -05:00
Brandon Thomas b691750df4 docs 2022-01-07 01:57:45 -05:00
Brandon Thomas 20676f595a only need one nginx file 2022-01-07 01:53:47 -05:00
Brandon Thomas ac95040be2 Add nginx config files (from mac) 2022-01-06 19:13:28 -05:00
Brandon Thomas 5c3afb0e68 note about migrations in prod 2022-01-06 03:09:07 -05:00
Brandon Thomas 14159a26a6 also sort the tts models 2022-01-05 02:08:00 -05:00
Brandon Thomas 963c5f7c32 natural+lexographic sort of category dropdown names 2022-01-05 02:04:55 -05:00
Brandon Thomas 62d894b826 Add deleted_at and other timestamps so it resembles other endpoints
It's not too bloated (# categories is tractable), and we need these for
endpoint uniformity
2022-01-03 05:54:47 -05:00
Brandon Thomas 85a21efaf6 Fix sqlx issue preventing builds
Move to Rust workspace broke how OFFLINE mode db schema/query cache is
read and stored.
2022-01-03 02:27:24 -05:00
Brandon Thomas 684603eebd Fix OBS builds 2022-01-03 01:56:52 -05:00
Brandon Thomas ad722ed505 show/hide categories with tri-state query params 2022-01-02 01:00:42 -05:00
Brandon Thomas d2f6fb5c3d make "delete category" a mod handler 2022-01-01 23:47:12 -05:00
Brandon Thomas a050c4d2de additional filtering on models 2021-12-31 06:25:26 -05:00
Brandon Thomas 7a83a51ca3 Fix bug with removing categories 2021-12-31 05:21:53 -05:00
Brandon Thomas f97cdc1ae5 tree integrity checks 2021-12-31 05:11:07 -05:00
Brandon Thomas 60cb078cd3 comment 2021-12-31 03:55:53 -05:00
Brandon Thomas c15f694a1d forgot a GET endpoint for single categories 2021-12-31 02:48:42 -05:00
Brandon Thomas 9f508aedbe Category assignment flag check 2021-12-31 02:05:33 -05:00
Brandon Thomas db7f5d20fe additional create category bool 2021-12-30 19:37:50 -05:00
Brandon Thomas 4777ca25fa Move edit category to moderation, add list handler 2021-12-30 02:49:42 -05:00
Brandon Thomas 8138766583 Endpoint to list categories for model (not working?) 2021-12-30 02:22:26 -05:00
Brandon Thomas adc365cf44 list assigned category query builder 2021-12-30 01:39:36 -05:00
Brandon Thomas 654f826598 add tts categories to model list results 2021-12-29 02:50:50 -05:00
Brandon Thomas e78e1079e3 test category assignments 2021-12-29 01:12:03 -05:00
Brandon Thomas 10726dde2b HTTP endpoint to assign / remove categories (untested) 2021-12-29 00:13:38 -05:00
Brandon Thomas 2f74df29ff shorter tokens, fix test 2021-12-28 22:53:13 -05:00
Brandon Thomas 556fa360d3 add list tts category handler 2021-12-28 03:14:37 -05:00
Brandon Thomas d3435a1f4b fix tests on list categories, split filtering of deleted/unapproved 2021-12-28 02:09:19 -05:00
Brandon Thomas 48394fe5f8 modify category schema; create category list query builder 2021-12-27 04:25:40 -05:00
Brandon Thomas 732c90f1e6 edit category endpoint 2021-12-22 05:10:29 -05:00
Brandon Thomas c34de2b8d7 Minor cleanup 2021-12-22 04:42:27 -05:00
Brandon Thomas d23859fb75 better rustfmt rules? still not ready to apply these 2021-12-22 03:36:26 -05:00
Brandon Thomas 1e0847ecdd hypothetical rustfmt rules (not yet applied to codebase) 2021-12-22 03:16:53 -05:00
Brandon Thomas eb11bb5118 Delete and undelete categories 2021-12-22 01:02:11 -05:00
Brandon Thomas 9668a3274e Add new params for mods in create category 2021-12-22 00:30:37 -05:00
Brandon Thomas 42637b2949 Fix create category and test endpoint, add idempotency 2021-12-22 00:12:58 -05:00
Brandon Thomas 9f0763b5ea Run cargo fix to fix imports 2021-12-21 23:48:17 -05:00
Brandon Thomas 7088b8657d category create route 2021-12-21 23:39:37 -05:00
Brandon Thomas 2119cfbe09 add an ip banlist error message 2021-12-21 23:08:10 -05:00
Brandon Thomas 591f3ac2ad organize routes module 2021-12-21 22:52:00 -05:00
Brandon Thomas 5db08c3b83 Move routes to their own file for maintainability 2021-12-21 12:27:51 -05:00
Brandon Thomas 18c3913f8f create category endpoint (no route) 2021-12-21 01:55:32 -05:00
Brandon Thomas bbc268aaef Empty rust modules, change schema to add w2l support 2021-12-20 22:45:14 -05:00
Brandon Thomas 4cb208bad7 Model category tables 2021-12-20 19:37:21 -05:00
Brandon Thomas 69dad0d854 move unused OBS migrations out of the way (for now) 2021-12-20 17:56:17 -05:00
Brandon Thomas 898fe142e9 Uncommitted old OBS code 2021-12-20 17:47:16 -05:00
Brandon Thomas 90950567e2 cors for fakeyou.com 2021-11-18 01:37:30 -05:00
Brandon Thomas 20e0f265c1 read more topics 2021-11-17 01:14:40 -05:00
Brandon Thomas 80db649b9f wip 2021-11-17 01:03:12 -05:00
Brandon Thomas 2514ec3356 wip websocket + twitch pubsub (not working) 2021-11-17 00:36:05 -05:00
Brandon Thomas 885ad53383 websockets basics work, cors fix 2021-11-16 22:56:29 -05:00
Brandon Thomas 39906ae9c2 begin testing websockets 2021-11-16 22:51:06 -05:00
Brandon Thomas fe7b8a8d07 now with refresh token 2021-11-16 20:41:29 -05:00
Brandon Thomas dd8945dc5e Oauth redemption works, but I'm hacking the CSRF 2021-11-16 20:36:22 -05:00
Brandon Thomas d370d13f2d OAuth flow compiles, but has issues 2021-11-16 20:00:16 -05:00
Brandon Thomas 6bf35a8381 oauth enrollment wip 2021-11-16 06:28:57 -05:00
Brandon Thomas 75aa1f81aa redirect oauth endpoint 2021-11-15 02:36:05 -05:00
Brandon Thomas 9b2c0edcc5 Twitch oauth enroll endpoint 2021-11-15 02:28:25 -05:00
Brandon Thomas c7989106b7 Attempt to fix dockerfile 2021-11-15 00:33:57 -05:00
Brandon Thomas 807365bd61 fixup loc.sh 2021-11-15 00:32:24 -05:00
Brandon Thomas 7e5f2b8c10 cleanup bucket client 2021-11-15 00:30:37 -05:00
Brandon Thomas 1e19067113 Repair model/ files that were overwritten for testing 2021-11-15 00:13:25 -05:00
Brandon Thomas 65934b2041 IP polling job works now. Migrated to Tokio runner 2021-11-13 00:46:34 -05:00
Brandon Thomas 6cb6c83dba clean up dependencies 2021-11-12 23:58:10 -05:00
Brandon Thomas a3bbf7b42c Refactor crate organization. Both server binaries build 2021-11-12 23:51:25 -05:00
Brandon Thomas 23f5051ace cleanup 2021-11-12 23:43:33 -05:00
Brandon Thomas 5ce4bd3b37 Cleanup IP filter 2021-11-12 23:35:43 -05:00
Brandon Thomas 4aa9724d41 BROKEN, BUT - filter works !! Needs cleanup and correct logic 2021-11-12 20:05:54 -05:00
Brandon Thomas 6849e6d051 HOLY SHIT, MIDDLEWARE ORDER MATTERED
https://issueexplorer.com/issue/actix/actix-extras/191
2021-11-12 19:52:00 -05:00
Brandon Thomas 38cc8f31a8 NOT WORKING (but close?) 2021-11-12 19:46:57 -05:00
Brandon Thomas 5c9da5fae5 Middleware not compiling, see:
https://stackoverflow.com/questions/68944823/returning-an-unauthorized-response-in-actix-web-middleware-in-rust
2021-11-12 18:12:13 -05:00
Brandon Thomas f2f39685a9 WIP filter (not working) 2021-11-12 04:36:50 -05:00
Brandon Thomas 2b3fdb87e0 BROKEN: IP filter compiles, but does not block 2021-11-12 03:30:15 -05:00
Brandon Thomas 30c26647da rust-s3 "never-encode-slash" feature seems to do the trick! 2021-11-12 03:01:37 -05:00
Brandon Thomas a26e11a294 BROKEN: OBS gateway now runs on same actix and shared code 2021-11-12 01:14:29 -05:00
Brandon Thomas c40d772ebc MAYBE BROKEN: Full actix/tokio/etc. upgrade on storyteller-web 2021-11-12 01:12:39 -05:00
Brandon Thomas e424297abf WIP 2021-11-12 00:07:17 -05:00
Brandon Thomas aa7c13ad5d BROKEN - rearrange workspace to group libraries 2021-11-11 22:20:39 -05:00
Brandon Thomas c55cc81022 TEMP BROKEN - need to upgrade storyteller-web, I think
The situation with selectively enabling different versions off actix
in a workspace using library features is crazy. It doesn't work,
anyway.
2021-11-11 22:13:53 -05:00
Brandon Thomas aa38f0a71f mostly working for two projects (broke 404 handler, index) 2021-11-09 23:12:04 -05:00
Brandon Thomas d0c156718a fix for obs-gateway (broken for a few commits now) 2021-11-09 23:00:39 -05:00
Brandon Thomas 6c9fc98c68 update docs 2021-11-09 22:18:47 -05:00
Brandon Thomas d209e7fd79 HACK: Multiple versions of actix in support package with features 2021-11-09 22:16:18 -05:00
Brandon Thomas 8a00f37e9e wip using common HTTP utils 2021-11-09 21:13:44 -05:00
Brandon Thomas 7256630d87 http common package versions that work with both apps 2021-11-08 05:02:42 -05:00
Brandon Thomas 5507e3bd6a setup for new oauth endpoints (disabled temporarily) 2021-11-08 04:48:36 -05:00
Brandon Thomas 5ba21a9771 more of the oauth flow, fixing tokio versions 2021-11-08 01:52:38 -05:00
Brandon Thomas 06a327367c versions of tokio/actix work for OBS gateway 2021-11-08 00:57:02 -05:00
Brandon Thomas a727e261d1 Figuring out Tokyo runtimes between projects (ugh...) 2021-11-08 00:19:56 -05:00
Brandon Thomas 5809dd7c40 Share CORS configs 2021-11-07 23:39:54 -05:00
Brandon Thomas 60e0ef5860 Twitch secrets handling, AnyhowResult in common crate, etc. 2021-11-07 23:32:21 -05:00
Brandon Thomas 9b2d2957ca websocket examples 2021-11-07 19:49:35 -05:00
Brandon Thomas 1fed826127 line count statistics fix 2021-11-07 15:39:24 -05:00
Brandon Thomas 18ce4e1c62 Move websocket endpoint to OBS app 2021-11-07 15:36:14 -05:00
Brandon Thomas f049a6f7d0 Make a shared "http server common" package 2021-11-07 15:24:28 -05:00
Brandon Thomas 0c409c6af1 Shared config package 2021-11-07 15:03:42 -05:00
Brandon Thomas f166837083 Fix up dockerfile for image builds 2021-11-07 14:37:13 -05:00
Brandon Thomas 5dd7efa2d5 Massive refactor: Two app packages in a workspace (5 binaries total) 2021-11-07 14:35:34 -05:00
Brandon Thomas e05d519e5a NEW OBS GATEWAY ARC (NOT YET WOKRING) 2021-11-07 14:07:01 -05:00
Brandon Thomas de80284665 util to get http hostname header (turns out I don't need it yet) 2021-09-28 01:09:14 -04:00
Brandon Thomas 5187d25e91 add fakeyou.com to CORS 2021-09-27 17:47:47 -04:00
Brandon Thomas 12543a1fdd oauth flow works, ugh 2021-09-27 00:32:30 -04:00
Brandon Thomas 6db56b89a4 no progress 2021-09-26 23:49:38 -04:00
Brandon Thomas 63c960a7aa user id lookup with helix 2021-09-26 23:20:34 -04:00
Brandon Thomas 0018e51eb5 attempt access tokens and scopes (failing) 2021-09-26 21:12:38 -04:00
Brandon Thomas c2eb31cbb2 listen wip 2021-09-26 20:33:51 -04:00
Brandon Thomas fc19a1430b listen command 2021-09-26 20:29:57 -04:00
Brandon Thomas 94ea57deac close method 2021-09-26 20:11:04 -04:00
Brandon Thomas b6ec22e343 this doesn't behave as I'd expect. 2021-09-26 20:07:02 -04:00
Brandon Thomas 00fef2a2d2 more structure, but still too rigid 2021-09-26 18:16:22 -04:00
Brandon Thomas 33867a5485 refactor 2021-09-26 17:49:22 -04:00
Brandon Thomas 90b43bf762 send ping 2021-09-26 12:26:12 -04:00
Brandon Thomas f67d048f27 connects to websockets (wrong library feature enabled) 2021-09-26 04:04:07 -04:00
Brandon Thomas e95ff9a7fa try to connect over websockets (400) 2021-09-26 03:08:34 -04:00
Brandon Thomas a0d9bdb0d5 read secrets file 2021-09-26 02:32:16 -04:00
Brandon Thomas 5e270d5c69 client successfully calls twitch with helix+secrets, not oauth flow 2021-09-26 02:23:37 -04:00
Brandon Thomas 1ccf1e90da Adding a Twitch client wrapper, secrets store 2021-09-25 16:50:34 -04:00
Brandon Thomas 82120fff8e First commit / hello world 2021-09-24 23:18:01 -04:00
Brandon Thomas 383a5a99ff tts model cache duration configurable 2021-09-20 01:25:44 -04:00
Brandon Thomas ef8711ab2e codegen 2021-09-20 00:48:36 -04:00
Brandon Thomas 8ec7f0956b TTL cache list of models in memory to de-strain the DB 2021-09-20 00:47:10 -04:00
Brandon Thomas 535f957467 codegen 2021-09-19 20:20:51 -04:00
Brandon Thomas b9e4087e3e mark jobs permanently dead if models are gone 2021-09-19 20:20:06 -04:00
Brandon Thomas 40b35fb642 warn to error level log 2021-09-19 19:33:57 -04:00
Brandon Thomas e3fd377257 codegen db for new endpoint 2021-09-17 02:58:32 -04:00
Brandon Thomas fb320f0338 endpoint to count voices 2021-09-17 02:50:14 -04:00
Brandon Thomas d29990b877 rename endpoint directory 2021-09-17 02:06:53 -04:00
Brandon Thomas d615a05930 Update README.md 2021-09-14 23:57:46 -04:00
Brandon Thomas ef4a25ee6e freaking dockerfile 2021-09-13 06:03:40 -04:00
Brandon Thomas 58af7c52c8 don't spam newrelic 2021-09-13 05:46:18 -04:00
Brandon Thomas 7bcb9090ae Add NewRelic tracing to tts-inference-job using vendored lib 2021-09-13 05:44:47 -04:00
Brandon Thomas bb10e6fc89 add temp file deletion for a few w2l inference error cases too 2021-09-12 17:42:47 -04:00
Brandon Thomas f26a3318c4 put in deletion of intermediate files (but not on error) 2021-09-12 17:39:56 -04:00
Brandon Thomas cf57772a39 delete intermediate results in tts inference 2021-09-12 17:37:17 -04:00
Brandon Thomas c934e6eeb4 delete intermediate results in w2l download job 2021-09-12 17:32:39 -04:00
Brandon Thomas aca73c32e3 make shared functions 2021-09-12 17:21:47 -04:00
Brandon Thomas 0450adb396 attempt to delete files after they're uploaded 2021-09-12 17:07:41 -04:00
Brandon Thomas 0d691ded80 fix tts download job from breaking 2021-09-12 16:45:22 -04:00
Brandon Thomas 5c8731eba9 silent k slur also works. ugh :( 2021-09-12 12:24:20 -04:00
Brandon Thomas aabf5579e1 fix pending queue bug when queue empty 2021-09-12 02:11:49 -04:00
Brandon Thomas 5ac58bd849 codegen db 2021-09-12 01:13:34 -04:00
Brandon Thomas ab974cecb2 add new pending w2l templates endpoint 2021-09-12 01:12:56 -04:00
Brandon Thomas a7d986d3f0 codegen 2021-09-12 00:38:19 -04:00
Brandon Thomas c6018b4ebd add seconds of waiting to job status 2021-09-12 00:37:47 -04:00
Brandon Thomas 3e9ff8ff7c fix failing test 2021-09-11 04:44:34 -04:00
Brandon Thomas d359427e42 fix rate limiter package 2021-09-11 04:43:17 -04:00
Brandon Thomas 591d828da3 more rate limiting for important endpoints 2021-09-11 04:27:40 -04:00
Brandon Thomas 4d928bd8de Rate limiter for TTS 2021-09-11 04:19:06 -04:00
Brandon Thomas 71dc65a5e4 codegen db 2021-09-11 02:49:38 -04:00
Brandon Thomas 3697c353cc stats for both queues 2021-09-11 02:48:04 -04:00
Brandon Thomas 00131daedf talknet downloads wip (BROKEN) 2021-09-10 05:16:58 -04:00
Brandon Thomas 620de4c528 Update tts_models schema to track TalkNet-related details 2021-09-10 04:21:47 -04:00
Brandon Thomas e3233f4c32 add talknet as a model type 2021-09-10 02:35:52 -04:00
Brandon Thomas c529756ab7 rename migration directory 2021-09-10 01:33:58 -04:00
Brandon Thomas 743f2bf560 Create "squashed" schema references with central documentation 2021-09-10 01:27:04 -04:00
Brandon Thomas 567a572487 Merge branch 'master' of github.com:storytold/storyteller-web 2021-09-09 23:59:06 -04:00
Brandon Thomas def7e4f3cf Update README.md 2021-09-09 23:58:40 -04:00
Brandon Thomas da16826ab5 talknet works 2021-09-09 03:01:06 -04:00
Brandon Thomas a681778046 end-to-end working? need to test the audio 2021-09-09 02:57:12 -04:00
Brandon Thomas 6db5f0187b model loading, arpabet 2021-09-09 02:38:38 -04:00
Brandon Thomas 694789cef8 notes + requirements 2021-09-08 22:41:09 -04:00
Brandon Thomas 27c05a6207 create WIP talknet server 2021-09-08 22:35:58 -04:00
Brandon Thomas 9f71d4ec33 Update README.md 2021-09-07 23:56:59 -04:00
Brandon Thomas 1ad7d5bc7e codegen 2021-09-06 08:52:53 -04:00
Brandon Thomas 412830e922 exclude deleted from leaderboard 2021-09-06 08:52:13 -04:00
Brandon Thomas ef5140e2f3 re-codegen for leaderboard 2021-09-06 07:48:58 -04:00
Brandon Thomas 922e5d5c99 add tts leaderboard 2021-09-06 07:48:23 -04:00
Brandon Thomas b59d19a7c8 add w2l results to leaderboard (wip) 2021-09-06 07:43:02 -04:00
Brandon Thomas eeef9cc916 fixup IP address handling 2021-09-06 06:56:36 -04:00
Brandon Thomas 24d6d86142 try to fix up IP handling 2021-09-06 06:09:54 -04:00
Brandon Thomas fffcdd8514 hide tts results from banned users (and codegen db) 2021-09-06 05:12:15 -04:00
Brandon Thomas 81fa3448e6 tts view hidden for banned users 2021-09-06 04:42:24 -04:00
Brandon Thomas cd85c61d0d add IP addresses, but probably not ideal to show in frontend list 2021-09-06 04:01:59 -04:00
Brandon Thomas d72958b749 list users endpoint 2021-09-06 01:43:28 -04:00
Brandon Thomas ec42723cf0 move query builders together 2021-09-05 22:22:24 -04:00
Brandon Thomas 451f394807 rename query builder 2021-09-05 22:17:15 -04:00
Brandon Thomas 562d37ee7a WIP query builder for moderator user list 2021-09-05 22:14:05 -04:00
Brandon Thomas 9711ce72b9 fix minor result error 2021-09-03 06:32:10 -04:00
Brandon Thomas 1ce4f66b1c codegen'd db 2021-09-03 06:09:46 -04:00
Brandon Thomas a794397369 hide w2l results made by banned inference users or template creators 2021-09-03 06:08:44 -04:00
Brandon Thomas eb75000c80 codegen db 2021-09-03 05:46:29 -04:00
Brandon Thomas f70bc0ca2e don't show w2l templates for banned users 2021-09-03 05:26:39 -04:00
Brandon Thomas e59fdb2251 don't report session status for banned 2021-09-03 05:17:13 -04:00
Brandon Thomas 5bafb0503f disallow editing profile for banned users 2021-09-03 05:09:33 -04:00
Brandon Thomas ecbc76d3b7 deny logins to banned users 2021-09-03 05:00:48 -04:00
Brandon Thomas 10d50fc684 hide banned users 2021-09-03 04:54:47 -04:00
Brandon Thomas b88966478b new "enable" endpoint to make opt-in easier 2021-09-03 03:29:39 -04:00
Brandon Thomas c123d499ba fix newlines issue 2021-09-03 02:41:42 -04:00
Brandon Thomas d1281a1f6c Rename audio files to include vocodes_ 2021-09-03 02:16:34 -04:00
Brandon Thomas 15a46805f7 update codegen queries 2021-09-02 04:50:06 -04:00
Brandon Thomas 2daee0ff83 move moderator fields to sub-message 2021-09-02 04:19:00 -04:00
Brandon Thomas 2a9e1a7eed refactor ban endpoint 2021-09-02 04:03:08 -04:00
Brandon Thomas 163fcabd73 light refactor 2021-09-02 03:54:57 -04:00
Brandon Thomas 2cedbb6ed9 allow usernames with dashes and underscores 2021-09-02 02:54:22 -04:00
Brandon Thomas e9662fef67 Add two WIP user ban endpoints 2021-09-02 02:45:36 -04:00
Brandon Thomas e6f8eb3b35 error messages for login 2021-09-01 04:40:17 -04:00
Brandon Thomas 75bfbe0753 check reserved usernames with dashes 2021-09-01 03:36:37 -04:00
Brandon Thomas 0b908906c0 more words to decline 2021-09-01 03:29:55 -04:00
Brandon Thomas dbd979f126 create account with better error responses 2021-09-01 02:51:52 -04:00
Brandon Thomas d336ff7985 Update README.md 2021-08-31 23:58:19 -04:00
Brandon Thomas 6239b2b765 re-codegen 2021-08-30 06:04:39 -04:00
Brandon Thomas d5646ebbdb add gravatar to model list 2021-08-30 06:04:01 -04:00
Brandon Thomas 7877a5505b re-codegen 2021-08-30 04:58:14 -04:00
Brandon Thomas a6bc7908c2 gravar hashes for w2l templates 2021-08-30 04:57:40 -04:00
Brandon Thomas d38322a868 Add TTS creator's gravatar hash 2021-08-30 04:40:28 -04:00
Brandon Thomas 2c8d512997 adjust relative imports 2021-08-29 05:05:47 -04:00
Brandon Thomas 584aedc905 clarifiying comment on requirements 2021-08-29 04:30:20 -04:00
Brandon Thomas df36f9c246 closer to import working... 2021-08-29 04:28:53 -04:00
Brandon Thomas 6dfb8eca48 requirements for talknet (wip) 2021-08-29 04:24:35 -04:00
Brandon Thomas 340267b394 move talknet, etc. for reuse 2021-08-29 04:17:59 -04:00
Brandon Thomas bcc31bcc04 adjust dockerfile and .env for new model location 2021-08-29 03:54:02 -04:00
Brandon Thomas 1a15029a22 reorganize tts models so pieces can be shared (BROKEN!) 2021-08-29 03:21:40 -04:00
Brandon Thomas d70142219a Move TalkNet out of tacotron2 2021-08-29 02:22:43 -04:00
Brandon Thomas 01a96f4141 Move NeMo/nemo out so it can be imported 2021-08-28 23:38:51 -04:00
Brandon Thomas 3839ae0dfc Add __init__ files for module imports 2021-08-28 23:28:06 -04:00
Brandon Thomas 5c1d1a1bce remove irrelevant requirements files 2021-08-28 23:18:47 -04:00
Brandon Thomas fb877bc290 ControllableTalkNet from https://github.com/SortAnon/ControllableTalkNet 2021-08-28 23:15:29 -04:00
Brandon Thomas f9871d9d05 Add NeMo from https://github.com/SortAnon/NeMo 2021-08-28 23:00:32 -04:00
Brandon Thomas b897245a09 re-codegen db 2021-08-28 04:36:39 -04:00
Brandon Thomas 5cc2ee3bda report status of tts downloads 2021-08-28 04:06:38 -04:00
Brandon Thomas cca6d9cdfc Return empty maybe_extra_status from TTS upload (WIP) 2021-08-28 02:38:24 -04:00
Brandon Thomas 1fa3b9b880 When the w2l job fails, fail permanently 2021-08-28 02:35:00 -04:00
Brandon Thomas 0fef8a6838 report on w2l template download status 2021-08-28 01:33:54 -04:00
Brandon Thomas f0aeb42d06 reuse as RedisJobStatusLogger 2021-08-27 23:30:31 -04:00
Brandon Thomas a8886db089 move redis key util (making more) 2021-08-27 22:54:22 -04:00
Brandon Thomas 09038a4b34 update to use youtube-dl fork 2021-08-27 22:47:11 -04:00
Brandon Thomas 33c5087544 job debugging 2021-08-27 02:40:16 -04:00
Brandon Thomas eca2b62d24 Merge branch 'master' of github.com:storytold/storyteller-web 2021-08-27 02:23:27 -04:00
Brandon Thomas 71b35183f9 improve safety of redis logging for tts 2021-08-27 02:16:33 -04:00
Brandon Thomas 75a938e0b3 in-progress extra status data for w2l inference 2021-08-27 02:05:40 -04:00
Brandon Thomas 2cbc86ddce report detailed TTS inference status 2021-08-27 01:22:27 -04:00
Brandon Thomas 1c524ed78b query redis status in tts inference endpoint 2021-08-27 00:47:39 -04:00
Brandon Thomas 3702332669 new redis keys 2021-08-26 23:59:51 -04:00
Brandon Thomas fb24e58d56 Update README.md 2021-08-26 00:00:15 -04:00
Brandon Thomas c396a91881 Massive update + schema change. Add vocoder flexibility 2021-08-25 04:00:57 -04:00
Brandon Thomas 90e1db42c4 Sidecar supports both vocoders and uses the one in the HTTP request 2021-08-25 02:21:59 -04:00
Brandon Thomas f4c8bb0095 plumbing for vocoders (mostly done) 2021-08-25 01:59:30 -04:00
Brandon Thomas 6ddc641475 intermediate plumbing for new vocoders (3) 2021-08-25 01:39:29 -04:00
Brandon Thomas a61e144ecb intermediate plumbing for new vocoders (2) 2021-08-25 01:32:37 -04:00
Brandon Thomas 21cffc1f03 intermediate plumbing for new vocoders 2021-08-25 01:11:36 -04:00
Brandon Thomas c9112b7714 remove unused model code 2021-08-25 00:33:24 -04:00
Brandon Thomas 79ee6e408a I think this works and sounds good!! 2021-08-22 21:28:18 -04:00
Brandon Thomas d7c6e0d68d almost working, but sounds super distorted 2021-08-22 21:26:11 -04:00
Brandon Thomas 3d61120ecb this appears to work end-to-end, but I need to output the sound 2021-08-22 21:15:19 -04:00
Brandon Thomas c52ce4de0a WIP pipeline with hifigan 2021-08-22 21:08:01 -04:00
Brandon Thomas a821afaebe I can now load hifigan models from TT 2021-08-22 20:27:02 -04:00
Brandon Thomas 76fd658ae6 move hifigan to make import disambiguation easier 2021-08-22 20:07:43 -04:00
Brandon Thomas e4fe7f8ed1 don't print devices 2021-08-22 19:42:07 -04:00
Brandon Thomas 6516a04eda print devices 2021-08-22 19:41:50 -04:00
Brandon Thomas d0ee1962d8 Move hifi-gan under tacotron2 2021-08-22 19:16:33 -04:00
Brandon Thomas 1a7fc2ab72 Add HifiGan model (https://github.com/SortAnon/hifi-gan.git) 2021-08-20 01:13:51 -04:00
Brandon Thomas d1e5cd9923 codegen db 2021-08-18 23:28:03 -04:00
Brandon Thomas c071bcfe1e return description for w2l templates 2021-08-18 23:27:26 -04:00
Brandon Thomas 7719262904 codegen sql 2021-08-17 03:52:44 -04:00
Brandon Thomas fd0dcb95a4 new endpoint to edit w2l result visibility (untested) 2021-08-17 03:52:01 -04:00
Brandon Thomas b3ee7bb1f7 Update result visibility (new endpoint) 2021-08-17 03:00:55 -04:00
Brandon Thomas 2522bfca91 update creator set visibility in models/templates (untested) 2021-08-17 00:58:23 -04:00
Brandon Thomas 5f71e30e2d re-codegen 2021-08-16 22:59:56 -04:00
Brandon Thomas 94cfaba606 Add creator_set_visibility to TTS model and W2L template 2021-08-16 22:59:14 -04:00
Brandon Thomas 20668c267b show visibility for W2L results 2021-08-15 22:39:20 -04:00
Brandon Thomas cf28558c27 return privacy on tts results 2021-08-15 22:26:32 -04:00
Brandon Thomas a2f2763759 Visibility in endpoints: don't list hidden results 2021-08-11 20:28:57 -04:00
Brandon Thomas 7738d45be0 use no-op logger in other 3 jobs (already in TTS inference) 2021-08-11 19:52:50 -04:00
Brandon Thomas ce21551109 fix types 2021-08-11 19:26:28 -04:00
Brandon Thomas 3967e1236c fix codegen 2021-08-11 17:45:16 -04:00
Brandon Thomas e4aa009750 result visibility editing fix 2021-08-11 17:44:15 -04:00
Brandon Thomas bf10676680 re-codegen 2021-08-07 18:51:57 -04:00
Brandon Thomas 92949a719b fix visibility db serialization bug 2021-08-07 18:51:09 -04:00
Brandon Thomas cd41803b7c re-codegen (need to update FE to respect profile edit) 2021-07-11 19:20:07 -04:00
Brandon Thomas cde4f33489 added to w2l 2021-07-11 19:19:37 -04:00
Brandon Thomas cc959f88fd hack record visibility 2021-07-11 19:14:26 -04:00
Brandon Thomas 6bcd1033a1 jobs: creator visibility propagation 2021-07-11 17:12:35 -04:00
Brandon Thomas 04ea0d7d8c more propagation of visibility 2021-07-11 16:49:03 -04:00
Brandon Thomas 444511d79e propagate visibility to enqueue tts infer 2021-07-11 16:38:26 -04:00
Brandon Thomas baffa751d6 visibility enums 2021-07-11 16:19:33 -04:00
Brandon Thomas bdf549cc1d enums work (not yet finished) 2021-07-11 16:15:07 -04:00
Brandon Thomas e7c0c5b6f0 codegen 2021-07-10 22:17:52 -04:00
Brandon Thomas a875e138eb model deletion improvement for tts results 2021-07-10 22:17:00 -04:00
Brandon Thomas 5586abe7a2 better delete for w2l results 2021-07-10 21:38:47 -04:00
Brandon Thomas 0e3059f906 better deletion for w2l templates 2021-07-10 21:12:19 -04:00
Brandon Thomas c306730c0b use common delete permission check 2021-07-10 13:30:31 -04:00
Brandon Thomas 2c342ac1d9 fixup tests 2021-07-10 13:25:28 -04:00
Brandon Thomas b0e09cf9c5 extracting delete role util (not yet used) 2021-07-10 13:22:08 -04:00
Brandon Thomas f24cdb6d38 store delete model IP address 2021-07-10 13:08:17 -04:00
Brandon Thomas b8e4dadaf3 re-codegen after refactor 2021-07-10 01:38:13 -04:00
Brandon Thomas db2b69fe53 fixup jobs from refactor 2021-07-10 01:37:38 -04:00
Brandon Thomas 103ef34b06 huge database module refactor, move under unified directory tree 2021-07-10 01:32:23 -04:00
Brandon Thomas f58a4353dd delete tts model 2021-07-09 22:20:36 -04:00
Brandon Thomas beb68b5051 env var controls 2021-07-06 02:26:58 -04:00
Brandon Thomas d2f0710097 cache strategies seem to work (too much logging though) 2021-07-06 02:22:13 -04:00
Brandon Thomas f28e405f6d tests on expiry 2021-07-05 23:30:57 -04:00
Brandon Thomas 424b98bb9d rename cache strategizer, add forget duration (untested) 2021-07-05 23:24:53 -04:00
Brandon Thomas 9c447e0442 multithreaded version 2021-07-05 22:57:43 -04:00
Brandon Thomas cd508ed946 cold cache tracking algorithm works 2021-07-05 22:16:36 -04:00
Brandon Thomas 453991f6d8 WIP cold cache strategy 2021-07-05 15:01:27 -04:00
Brandon Thomas 51ba9517d9 sort model names alphabetically 2021-07-05 11:46:29 -04:00
Brandon Thomas bd289a06b3 wait on cold memory 2021-07-05 11:41:18 -04:00
Brandon Thomas 26be0594e8 control number of sidecar models 2021-07-05 10:41:14 -04:00
Brandon Thomas b476485cd7 model loading/unloading works 2021-07-05 10:33:48 -04:00
Brandon Thomas 4da28003f2 attempt at running LRU for the sidecar 2021-07-05 02:18:20 -04:00
Brandon Thomas 304312ce6f stupid string reference. Ugh. 2021-07-05 01:15:16 -04:00
Brandon Thomas aced214213 lightweight LFU cache that returns the discarded key 2021-07-04 23:38:06 -04:00
Brandon Thomas 13c4f22e49 Perform TTS using a sidecar HTTP server 2021-07-03 01:35:36 -04:00
Brandon Thomas 5bc943a9f5 server seems to work! 2021-07-02 17:38:58 -04:00
Brandon Thomas 560beb0773 progress on loading models from multiple args 2021-07-02 17:27:02 -04:00
Brandon Thomas 321322c0a5 server is working and fast, but need to wire it up for API 2021-07-02 16:39:27 -04:00
Brandon Thomas 21ac34b8a5 wip 2021-07-02 04:21:31 -04:00
Brandon Thomas 3bbab7232c Working on porting HTTP server from old project
https://github.com/ml-applications/voder/blob/7e33d9c7ca45bc4cd1d05011d5be4a4d035e9c82/cycle_gan/demo_server.py
2021-07-02 03:13:48 -04:00
Brandon Thomas fada5e6b29 some cold caching logic - skip worker once if cache is cold 2021-06-30 17:09:18 -04:00
Brandon Thomas 00d95f9e88 no-op logger 2021-06-30 05:00:53 -04:00
Brandon Thomas 196efc52c1 "no-op logger" to reduce log spam 2021-06-30 04:58:03 -04:00
Brandon Thomas e302fe834c make easier to reconfigure 2021-06-27 18:07:53 -04:00
Brandon Thomas 9515a8c3cc re-codegen db for badges in profile 2021-06-27 00:23:39 -04:00
Brandon Thomas ca5a9cf0ef add badges to profile endpoint 2021-06-27 00:23:03 -04:00
Brandon Thomas 679be23066 re-codegen db 2021-06-27 00:04:44 -04:00
Brandon Thomas 6b745fd3b0 user badges + user badge granter + integrated into grant call sites 2021-06-27 00:03:48 -04:00
Brandon Thomas 0ca7ceadab completely reorganize readme 2021-06-26 20:21:20 -04:00
Brandon Thomas 949e707c7e update 404, index, and alpha controllers 2021-06-26 14:19:57 -04:00
Brandon Thomas c3464c4fe3 uppercase user tokens 2021-06-26 13:46:38 -04:00
Brandon Thomas 10f86bf513 revize tokens in the system 2021-06-26 13:09:29 -04:00
Brandon Thomas 68f355846f didn't want to lose my github streak. ugh, work :( 2021-06-24 23:59:22 -04:00
Brandon Thomas 3b8aa0a7c6 more install instructions 2021-06-23 01:35:29 -04:00
Brandon Thomas 847bbb935c python3.6 on apple m1 mac 2021-06-22 02:35:13 -04:00
Brandon Thomas ee4be7dc94 instructions 2021-06-20 23:55:13 -04:00
Brandon Thomas 6b20a11595 install instructions for mac 2021-06-20 11:58:04 -04:00
Brandon Thomas 51bbdf61ba Update README.md 2021-06-19 23:58:38 -04:00
Brandon Thomas 84444c3380 work on better tokens 2021-06-18 05:25:45 -04:00
Brandon Thomas 8d8209d1f8 get rid of a few columns (tts results) 2021-06-18 05:07:28 -04:00
Brandon Thomas c406972175 store bucket uuid 2021-06-18 02:50:23 -04:00
Brandon Thomas 4ded82b3c7 fix path bug 2021-06-18 02:38:40 -04:00
Brandon Thomas 2f49daae78 fix column swap bug 2021-06-18 02:33:41 -04:00
Brandon Thomas 6af385dd48 normalize and correct cashapp 2021-06-17 03:10:18 -04:00
Brandon Thomas a82572ee5b normalize twitter username 2021-06-17 02:57:31 -04:00
Brandon Thomas ceee067734 re-codegen db 2021-06-17 02:18:47 -04:00
Brandon Thomas 34c66465ce mod-only response for w2l result 2021-06-17 01:53:12 -04:00
Brandon Thomas 8463a16fe1 remove extraneous logging 2021-06-17 01:47:31 -04:00
Brandon Thomas 02c1442e6c mod fields for TTS results 2021-06-17 01:43:56 -04:00
Brandon Thomas 12466896e0 GET TTS model cleanup, add mod-only fields 2021-06-17 01:37:30 -04:00
Brandon Thomas caac64c567 moderator-only fields for W2L templates 2021-06-17 01:05:06 -04:00
Brandon Thomas 38e1c4d692 fix routes 2021-06-16 23:43:53 -04:00
Brandon Thomas 98b71277ac IP bans work! 2021-06-16 01:30:51 -04:00
Brandon Thomas 8b95ea3abd ip filter middleware (not rejecting yet) 2021-06-16 00:45:51 -04:00
Brandon Thomas b783fe5bcb cleanup 2021-06-16 00:23:59 -04:00
Brandon Thomas 38ed9f6804 this works! ip ban polling async that doesn't stop interrupts
Need to clean this up now...
2021-06-16 00:17:41 -04:00
Brandon Thomas e5d6528788 this works, but takes 30 seconds! 2021-06-15 01:38:04 -04:00
Brandon Thomas c8818e7e3b add ip ban polling thread (not yet wired up to executor) 2021-06-15 00:12:54 -04:00
Brandon Thomas 8776893774 ip address validation 2021-06-14 04:20:33 -04:00
Brandon Thomas f25d731fc4 don't show deleted bans 2021-06-14 03:33:31 -04:00
Brandon Thomas 92fda195ec get single IP ban info 2021-06-14 03:12:16 -04:00
Brandon Thomas af11a1eddf add mod details to ip address ban list 2021-06-14 02:46:25 -04:00
Brandon Thomas 4db289c3c0 codegen db 2021-06-13 06:31:07 -04:00
Brandon Thomas 2b1cf957c7 synthetic ids for w2l 2021-06-13 06:30:28 -04:00
Brandon Thomas 76c2fe446c synthetic IDs for TTS 2021-06-13 06:17:43 -04:00
Brandon Thomas 31effd2ea8 synthetic ids work (but need finishing and cleanup) 2021-06-13 06:11:18 -04:00
Brandon Thomas 5c76623907 redis-based counts for w2l 2021-06-13 03:56:26 -04:00
Brandon Thomas 3d8da4598f add model use counts 2021-06-13 03:39:09 -04:00
Brandon Thomas 323bf9ea8d move bucket utils under ./utils so it's with similar stuff 2021-06-13 03:12:50 -04:00
Brandon Thomas 30dfe649ae configure redis with env var 2021-06-13 03:04:04 -04:00
Brandon Thomas c416069f69 write redis with tts use count (needs connection config) 2021-06-13 02:56:24 -04:00
Brandon Thomas f21bac526c add model title in tts results list 2021-06-13 01:58:12 -04:00
Brandon Thomas b380a3197c fix markdown from containing HTML !!!! also: temporary no-entropy cursors 2021-06-13 01:17:31 -04:00
Brandon Thomas 1a98e10a4f fix 2021-06-12 19:13:40 -04:00
Brandon Thomas 6e4f1225a6 fix endpoint, fix bug, add tests (not tested in browser) 2021-06-11 23:41:35 -04:00
Brandon Thomas 255f54c39a all predicates for W2L pagination (endpoint is no-op temporarily) 2021-06-11 23:27:03 -04:00
Brandon Thomas a2e4098fd6 mod check (manually tested the cursors - they work!) 2021-06-11 22:12:17 -04:00
Brandon Thomas 75df0cda4a cleanup (let's test if it works...) 2021-06-11 22:02:21 -04:00
Brandon Thomas 9aac3beb9c query mechanics in the builder 2021-06-11 21:47:51 -04:00
Brandon Thomas 806339d295 tests for all predicates 2021-06-11 21:33:15 -04:00
Brandon Thomas e7dc15d832 offset predicate 2021-06-11 21:26:14 -04:00
Brandon Thomas 981b2f746a another predicate 2021-06-11 21:23:49 -04:00
Brandon Thomas e7c3db608d wip query builder 2021-06-11 21:10:17 -04:00
Brandon Thomas ea64e212b3 sorting both ways seems to work 2021-06-11 20:49:32 -04:00
Brandon Thomas 76e3f96a86 fix tts dl job 2021-06-11 19:58:23 -04:00
Brandon Thomas 0713de8658 pagination from query string (untested) 2021-06-11 19:18:30 -04:00
Brandon Thomas 50b694f8e6 paginated queries 2021-06-11 18:58:37 -04:00
Brandon Thomas be40729ee8 order by clause (not tested) 2021-06-11 18:45:00 -04:00
Brandon Thomas adf3741d85 wip untested dynamic query builder for tts results 2021-06-11 04:52:03 -04:00
Brandon Thomas c015f431b2 sort key crypto tool added to server 2021-06-11 03:34:56 -04:00
Brandon Thomas 84548abf76 entropy + tests 2021-06-11 03:29:15 -04:00
Brandon Thomas af4c831aaa sort key encrypter (so we don't leak how big our database is) 2021-06-11 03:23:56 -04:00
Brandon Thomas 4fe9305099 set user role handler (untested) 2021-06-11 02:38:20 -04:00
Brandon Thomas d603b832cf add staff list endpoint (untested) 2021-06-11 02:24:55 -04:00
Brandon Thomas 03d8b9ada2 list user roles endpoint (untested) 2021-06-11 00:54:35 -04:00
Brandon Thomas 1a341c5705 move moderation handler files 2021-06-11 00:31:30 -04:00
Brandon Thomas c985269953 list bans endpoint (not tested) 2021-06-11 00:11:21 -04:00
Brandon Thomas 1be0d3b0eb use to_simple_json_error to replace all old, verbose constructions 2021-06-10 23:38:40 -04:00
Brandon Thomas a3cb58e716 delete/undelete ip address ban handler 2021-06-10 23:25:55 -04:00
Brandon Thomas 214f048967 add ip ban handler (untested); stubs for other endpoints 2021-06-10 23:06:46 -04:00
Brandon Thomas 10a84b624e no mod comments on inference results 2021-06-10 22:13:03 -04:00
Brandon Thomas 848233b6fa add mod details editing to w2l templates 2021-06-10 22:01:02 -04:00
Brandon Thomas 544c61b0a8 add one more field 2021-06-10 21:53:27 -04:00
Brandon Thomas fe75726e04 add moderator fields to edit_tts_model endpoint 2021-06-10 21:49:15 -04:00
Brandon Thomas 812f43254c fix code to deal with moderation field renames and deletes 2021-06-10 14:18:14 -04:00
Brandon Thomas 653fa93c8a Don't need these colums / column renames 2021-06-10 14:08:16 -04:00
Brandon Thomas 8e633ee5c5 propagate schema changes through to code (all binaries run) not tested 2021-06-10 04:59:42 -04:00
Brandon Thomas 728e7363f2 get rid of indices against deleted columns 2021-06-10 04:06:52 -04:00
Brandon Thomas 8eebffd7fe more schema changes 2021-06-10 04:03:49 -04:00
Brandon Thomas 2c6172eb88 don't need these 2021-06-10 03:54:00 -04:00
Brandon Thomas 3b8c1e7531 more schema changes (code breaking) 2021-06-10 03:46:46 -04:00
Brandon Thomas c2a6663e87 more user model changes (code breaking changes) 2021-06-10 03:20:46 -04:00
Brandon Thomas 12ebee4523 changes to user (code breaking) 2021-06-10 03:12:22 -04:00
Brandon Thomas 9587d2a548 major tts/w2l schema changes (won't compile / broken code) 2021-06-10 03:00:23 -04:00
Brandon Thomas bdc6e6d1e9 cleanup get_tts_result endpoint to use shared queries 2021-06-10 02:04:36 -04:00
Brandon Thomas 1496090142 tts inference result delete endpoint (untested) 2021-06-10 01:59:56 -04:00
Brandon Thomas 0a1aa0aeab forbid private types in public 2021-06-10 01:49:18 -04:00
Brandon Thomas 727c57ddaa delete w2l results endpoint (not tested) 2021-06-10 01:45:36 -04:00
Brandon Thomas dfb552abfc prevent locked templates/models from being edited by non-mods 2021-06-10 00:38:22 -04:00
Brandon Thomas 3065f20f9f add endpoint for editing tts models (untested) 2021-06-10 00:29:38 -04:00
Brandon Thomas ec1e280eda new edit w2l endpoint (untested) + http helper functions 2021-06-10 00:11:40 -04:00
Brandon Thomas 72a0ca01d9 seed with new permissions 2021-06-09 22:41:22 -04:00
Brandon Thomas 5cee2f4c5e more permissions 2021-06-09 22:37:28 -04:00
Brandon Thomas 7d1d1c1791 add new permissions (unused) 2021-06-09 22:27:12 -04:00
Brandon Thomas 2fcae0a39c fixup all queries for user_deleted_at / mod_deleted_at (untested) 2021-06-09 22:05:42 -04:00
Brandon Thomas 318221549b columns to prevent user modification 2021-06-09 04:36:45 -04:00
Brandon Thomas 2d776517cc delete schemas, two types of deleted record (WIP - code broken) 2021-06-09 04:33:32 -04:00
Brandon Thomas 342f9cd10e new tables 2021-06-09 04:15:11 -04:00
Brandon Thomas 4485cf34d4 add attempt_count to all job status endpoints 2021-06-08 12:12:42 -04:00
Brandon Thomas c9a82d46eb prevent slurs in username and w2l titles 2021-06-08 12:02:29 -04:00
Brandon Thomas 8393095be2 job dead letter queueing (attempt count + config) 2021-06-08 03:16:04 -04:00
Brandon Thomas b01b83cccf job max attempts 2021-06-08 03:05:31 -04:00
Brandon Thomas e83c003320 central config for batch query timeout 2021-06-08 02:49:11 -04:00
Brandon Thomas 1bc18487f0 sort results 2021-06-08 01:58:17 -04:00
Brandon Thomas 40b029274e re-codegen db 2021-06-08 01:56:37 -04:00
Brandon Thomas e7018c085b w2l inference job locks (not tested) 2021-06-08 01:55:57 -04:00
Brandon Thomas f088116dfa job lock for w2l downloader (not tested) 2021-06-08 01:51:57 -04:00
Brandon Thomas c08000d11a lock on tts download job (not tested) 2021-06-08 01:42:49 -04:00
Brandon Thomas 23801d90f6 remove debug log 2021-06-08 01:08:39 -04:00
Brandon Thomas 9ce83025b4 mutual exclusion seems to work well! 2021-06-08 00:47:41 -04:00
Brandon Thomas 373726b685 this locking appears to work (testing) 2021-06-08 00:36:23 -04:00
Brandon Thomas b6bd4ab68c fix debugging script 2021-06-07 23:57:21 -04:00
Brandon Thomas af80527c47 Check TT2 model for validity and store file size 2021-06-07 22:56:56 -04:00
Brandon Thomas df765663eb good permissions settings for w2l templates! 2021-06-07 03:11:11 -04:00
Brandon Thomas 824324f204 expose delete handler 2021-06-07 02:53:08 -04:00
Brandon Thomas 7bec75e755 fix for mods 2021-06-07 02:23:30 -04:00
Brandon Thomas 93ac3c6c49 fix edit profile bug 2021-06-07 02:22:01 -04:00
Brandon Thomas 71e5eb3492 scripts to toggle userroles 2021-06-07 02:06:30 -04:00
Brandon Thomas 3d23461863 fix seed script 2021-06-07 02:06:12 -04:00
Brandon Thomas 76b1e9ffed codegen 2021-06-07 01:58:45 -04:00
Brandon Thomas e62fffe11f delete endpoint; revised permissions 2021-06-07 01:58:15 -04:00
Brandon Thomas 8143409ada moderate endpoint exposed 2021-06-07 01:19:57 -04:00
Brandon Thomas 8642674481 codegen 2021-06-07 00:48:10 -04:00
Brandon Thomas 7d02dc5e00 rename column 2021-06-07 00:47:42 -04:00
Brandon Thomas 94f8ab15bc reuse select query 2021-06-07 00:39:23 -04:00
Brandon Thomas 13e2e32ca5 wip on moderation of templates 2021-06-07 00:32:15 -04:00
Brandon Thomas 9495798583 template mod approval -> tri state, db helpers 2021-06-06 23:13:19 -04:00
Brandon Thomas b6a8c40ddb add to get profile handler 2021-06-06 19:18:40 -04:00
Brandon Thomas abc8264304 more info from session endpoint 2021-06-06 17:52:07 -04:00
Brandon Thomas 0cc67e3107 no more annoying warnings 2021-06-06 17:44:32 -04:00
Brandon Thomas b513dddbb6 re-codegen db 2021-06-06 17:41:53 -04:00
Brandon Thomas 8639d7b804 fixup initial role 2021-06-06 17:40:12 -04:00
Brandon Thomas bc3fee54d6 actual permissions 2021-06-06 17:36:43 -04:00
Brandon Thomas 5ec3c9cc3c seed script to populate user_roles 2021-06-06 17:33:47 -04:00
Brandon Thomas 6274250fbf fixup website validations 2021-06-06 17:25:08 -04:00
Brandon Thomas 4bc948d0ac A ton of new functionality to support editing profiles 2021-06-06 17:23:39 -04:00
Brandon Thomas 802a348fb5 re-codegen queries 2021-06-06 00:56:43 -04:00
Brandon Thomas d7a9f88493 status check endpoint for w2l upload 2021-06-06 00:14:51 -04:00
Brandon Thomas 004bc71e96 TTS upload job status 2021-06-05 23:49:16 -04:00
Brandon Thomas 7638c640ff move profile URL 2021-06-05 23:37:28 -04:00
Brandon Thomas 3aded66c09 ban slurs from being said 2021-06-05 16:38:19 -04:00
Brandon Thomas d5ed1d9c3b add result fields to upload jobs 2021-06-05 16:08:59 -04:00
Brandon Thomas dfc52681cd calculate audio metadata 2021-06-05 15:47:21 -04:00
Brandon Thomas 9c1a1e88f9 simplify mel generation 2021-06-05 15:36:30 -04:00
Brandon Thomas f804d0216b some form of spectrogram 2021-06-05 14:13:31 -04:00
Brandon Thomas 000f3b9ef5 put spectrogram into correct dimensions 2021-06-04 03:58:17 -04:00
Brandon Thomas ec450230f8 saves spectrogram json and uploads it! 2021-06-04 03:54:02 -04:00
Brandon Thomas 47c391571a update docs on denying public listing on public buckets 2021-06-04 03:39:31 -04:00
Brandon Thomas ce6c39b6c7 respond with expected response 2021-06-04 03:20:23 -04:00
Brandon Thomas 91f37486e2 update job completion result token 2021-06-04 02:51:11 -04:00
Brandon Thomas f14a935012 new endpoint to report w2l inference status 2021-06-04 02:46:18 -04:00
Brandon Thomas 870eba8a9c improvements 2021-06-04 02:06:52 -04:00
Brandon Thomas cda1bbda41 return bucket path 2021-06-04 00:50:24 -04:00
Brandon Thomas 19473726c6 endpoint to report status of tts inference 2021-06-03 20:06:43 -04:00
Brandon Thomas 0202dd4d43 fix response key 2021-06-03 17:25:13 -04:00
Brandon Thomas e2e7950dd9 build fixed 2021-06-03 03:11:07 -04:00
Brandon Thomas 9a4a8fd23a fixed? still errors... 2021-06-03 03:07:14 -04:00
Brandon Thomas 6702b42808 more fixed 2021-06-03 02:50:04 -04:00
Brandon Thomas e8dc191d8e fix four more errors 2021-06-03 02:44:17 -04:00
Brandon Thomas 3022193ff7 fixed errors on one endpoint 2021-06-03 02:35:31 -04:00
Brandon Thomas a9aa0a5b50 (BROKEN): WIP new endpoints for TTS models, results, etc. 2021-06-03 02:14:19 -04:00
Brandon Thomas ae32779c35 reserve one-letters and a few more 2021-06-03 01:10:10 -04:00
Brandon Thomas 7904f6e56b sorted, dupes removed 2021-06-03 01:04:27 -04:00
Brandon Thomas 7b833d7c66 more reserved words 2021-06-03 01:03:34 -04:00
Brandon Thomas 57ae2343dd stupid, but makes me smile 2021-06-02 23:37:06 -04:00
Brandon Thomas 71a19e4794 re-codegen db 2021-06-02 23:22:04 -04:00
Brandon Thomas 716a75c4f4 THAT DID THE TRICK! I was using the wrong wav encoding! 2021-06-02 22:35:08 -04:00
Brandon Thomas a1c77fb527 Copying waveglow files @ 2fd4e63 (per collab synthesis.ipynb) 2021-06-02 22:26:55 -04:00
Brandon Thomas 7744f0e324 working on adapting the waveglow/inference to sound non-noisy 2021-06-02 22:17:27 -04:00
Brandon Thomas 077a4239d8 sounds better, but still bad 2021-06-02 21:53:30 -04:00
Brandon Thomas ae91e19b9f fixup filename, debugging 2021-06-02 21:15:33 -04:00
Brandon Thomas 9d46818a56 fixup 2021-06-02 21:06:30 -04:00
Brandon Thomas ef994670f2 fixed bugs introduced 2021-06-02 20:59:40 -04:00
Brandon Thomas cf20f1a558 Add text hash to tts_results; also mistakenly merge branch 'master'
Ugh, how did I get a merge into my working branch without noticing? and
there were merge conflicts!!
2021-06-02 20:44:10 -04:00
Brandon Thomas 3f1a5fa729 hack, kind of works.
Wav doesn't play in firefox, vlc. Only asound. It sounds awful.

Need to fix paths and so many other things
2021-06-02 00:55:28 -04:00
Brandon Thomas 7003e5431e better, but still not working 2021-06-02 00:48:42 -04:00
Brandon Thomas dadb26c5f2 path bugfixing (still not working) 2021-06-02 00:28:54 -04:00
Brandon Thomas 22de06afe0 fixup local env vars 2021-06-01 16:23:06 -04:00
Brandon Thomas 46f878beaa tts inference script 2021-06-01 16:21:03 -04:00
Brandon Thomas 86b9d2ecca fixup tts_inference_job (python still needs writing) 2021-06-01 14:29:40 -04:00
Brandon Thomas a0919fffee overhaul tts_job 2021-06-01 14:23:16 -04:00
Brandon Thomas 0f2da6f6e5 fix column name 2021-06-01 13:32:53 -04:00
Brandon Thomas 79f8b0ad7f add bucket paths for TTS (untested) 2021-06-01 03:02:05 -04:00
Brandon Thomas 5a1dafdc21 local filesystem paths 2021-06-01 02:17:54 -04:00
Brandon Thomas 05c9eff1c5 TTS inference queries+codegen, job/script WIP 2021-06-01 02:03:52 -04:00
Brandon Thomas 164cb46fff add debug print to tts inference script 2021-05-31 23:42:29 -04:00
Brandon Thomas 446983a477 another video 2021-05-31 23:40:59 -04:00
Brandon Thomas ff9c8e73e4 seed tts models, youtube videos 2021-05-31 23:21:22 -04:00
Brandon Thomas 2e61978258 more firehose events and add new column! 2021-05-31 22:50:03 -04:00
Brandon Thomas 14a918a9c6 update endpoint to set token and require idempotency token 2021-05-31 22:22:48 -04:00
Brandon Thomas 335d355d64 add w2l deps, update readme 2021-05-31 21:45:45 -04:00
Brandon Thomas 16f6e6ebef use a shared common default log-level and db password 2021-05-31 20:44:59 -04:00
Brandon Thomas e224eee89f FREAKING HUGE MYSQL IN DEV YAK SHAVE 2021-05-31 20:24:50 -04:00
Brandon Thomas 236b1210e6 simplify python install 2021-05-31 18:34:38 -04:00
Brandon Thomas 8574ed0796 fix dockerfile 2021-05-31 18:32:48 -04:00
Brandon Thomas e31a5557b6 add working requirements 2021-05-31 18:29:03 -04:00
Brandon Thomas 5f77848304 wav inference works e2e! It's got staticy output, works! 2021-05-31 17:58:21 -04:00
Brandon Thomas f23ceb22bf add waveglow @ master 2021-05-31 17:53:42 -04:00
Brandon Thomas 79f7c6c82d mel histograms look good! (this is just a test) 2021-05-31 17:38:56 -04:00
Brandon Thomas 49dde0a2ff Add utility from my old experimentation (details)
~/dev/3rd/nvidia-tacotron2

commit f6be28d1f89b5e0bae89a771c5d116722f8661cb
Author: Brandon Thomas <echelon@gmail.com>
Date:   Sat Jan 11 01:24:26 2020 -0500

    Running on CPU, also wav images
2021-05-31 17:36:43 -04:00
Brandon Thomas 04bdfa77fb spectrogram inference works ! 2021-05-31 17:33:09 -04:00
Brandon Thomas 34940f75b1 inference wip 2021-05-31 17:26:32 -04:00
Brandon Thomas 14f1fd327c requirements from halide that seem to be almost working 2021-05-31 17:21:55 -04:00
Brandon Thomas 21c2194828 additional comment 2021-05-31 16:53:25 -04:00
Brandon Thomas a423cf6de9 a bunch of alternative requirements files 2021-05-31 16:52:41 -04:00
Brandon Thomas b98f250c07 debug sleep for w2l download job 2021-05-31 15:45:40 -04:00
Brandon Thomas 9b0f6badce rename download script 2021-05-31 14:54:21 -04:00
Brandon Thomas 81ab8797d3 add python's youtube-dl 2021-05-31 14:43:18 -04:00
Brandon Thomas 6f1cf06dd6 Merge branch 'master' of github.com:storytold/storyteller-web 2021-05-31 14:42:20 -04:00
Brandon Thomas a9aa9c692f improve download script 2021-05-31 14:42:10 -04:00
Brandon Thomas 7bca17ad73 put tacotron in the correct place 2021-05-30 16:47:54 -04:00
Brandon Thomas ccd9a69ad7 build with cached base image (test)
let's see if this goes faster
2021-05-30 16:43:35 -04:00
Brandon Thomas 6201f5c49a install nvidia drivers 2021-05-30 16:03:44 -04:00
Brandon Thomas 3b5c0b70eb add pciutils 2021-05-30 15:30:04 -04:00
Brandon Thomas 8abe0eee62 notes 2021-05-30 15:24:26 -04:00
Brandon Thomas a05b1ed551 revert Wav2Lip using Python3.6 with a PPA hack 2021-05-30 14:41:39 -04:00
Brandon Thomas eee60e3cdd upgrade python package 2021-05-30 13:44:43 -04:00
Brandon Thomas 1d097c1a64 update dockerfile 2021-05-30 13:38:54 -04:00
Brandon Thomas d52bdc6a10 update dockerfile 2021-05-30 13:34:07 -04:00
Brandon Thomas 18830fea61 I needed to actually re-specify .gitignore to not pass to docker ctx 2021-05-30 13:22:57 -04:00
Brandon Thomas e0479aa1da Change dockerfile base image 2021-05-30 13:14:55 -04:00
Brandon Thomas 5e0a1d2e7d Fix dockerfile again 2021-05-30 07:04:42 -04:00
Brandon Thomas 41fc0ee1ec fix requirements? 2021-05-30 06:45:57 -04:00
Brandon Thomas 8655e99e43 fix dockerfile && 2021-05-30 06:19:16 -04:00
Brandon Thomas 943047e59c an old "inference" script I found seems to work :whatever: 2021-05-30 06:09:33 -04:00
Brandon Thomas ecc2c3bec6 I installed my own requirements.txt somehow not realizing it was there
what
2021-05-30 04:55:49 -04:00
Brandon Thomas 79a21570e9 re-codegen queries 2021-05-30 04:50:06 -04:00
Brandon Thomas f5f5a8dd93 add tacotron2 2021-05-30 04:27:51 -04:00
Brandon Thomas fd2b01334b more firehose event types 2021-05-30 04:12:32 -04:00
Brandon Thomas f27908d4a2 add gravatar hash 2021-05-30 03:50:58 -04:00
Brandon Thomas 6ab5bac9dc add events endpoint 2021-05-30 03:02:47 -04:00
Brandon Thomas f601ec9aa1 events for several things 2021-05-30 02:41:17 -04:00
Brandon Thomas fca64a6cca firehose publishing 2021-05-30 02:12:27 -04:00
Brandon Thomas b3a0b49bc1 report gravatar and template creator for inf result 2021-05-30 00:42:22 -04:00
Brandon Thomas e84070f5bb add video bucket path 2021-05-30 00:35:24 -04:00
Brandon Thomas ea566c465e new endpoint to show singular inference results 2021-05-29 23:44:18 -04:00
Brandon Thomas 4f62a865a5 add title 2021-05-29 21:17:42 -04:00
Brandon Thomas 910b3db1eb update seed tool 2021-05-29 20:47:59 -04:00
Brandon Thomas 510c8ed09b add a seed script that populates a lot more data 2021-05-29 20:29:17 -04:00
Brandon Thomas b6c54f23fa fix username bug 2021-05-29 20:12:56 -04:00
Brandon Thomas bef1036d40 session debugging 2021-05-29 19:59:00 -04:00
Brandon Thomas cf060ea1ff user inference result endpoint (wip) 2021-05-29 19:15:47 -04:00
Brandon Thomas f90839f87f fix query, share code 2021-05-29 16:29:27 -04:00
Brandon Thomas 42d221bd79 endpoint to list w2l templates 2021-05-29 16:25:55 -04:00
Brandon Thomas ece7d66e58 end bump 2021-05-29 15:12:11 -04:00
Brandon Thomas dbca8e7fd9 add tokens to upload jobs, reorganize schemas, codegen 2021-05-29 14:40:04 -04:00
Brandon Thomas 063780db3a this might be close... 2021-05-29 14:13:36 -04:00
Brandon Thomas 2d7f46cc57 progress, but broke one of the jobs 2021-05-29 13:58:06 -04:00
Brandon Thomas a8211a1f9b this fixes duration metadata 2021-05-29 13:20:50 -04:00
Brandon Thomas 9075f97d7a output metadata (wrongish?) 2021-05-29 13:03:19 -04:00
Brandon Thomas 6ceed517de end filename 2021-05-29 12:36:45 -04:00
Brandon Thomas f886cecf8d it works?? I need to save the results somewhere 2021-05-29 12:20:46 -04:00
Brandon Thomas 62b6b70e36 download template media, start work on process script 2021-05-29 12:07:05 -04:00
Brandon Thomas 6d7f9ba872 inference job (doesn't work) 2021-05-29 02:41:57 -04:00
Brandon Thomas b4b8222649 download audio 2021-05-29 02:27:16 -04:00
Brandon Thomas e2cc57dd1e change name 2021-05-29 01:28:38 -04:00
Brandon Thomas 9e9c4deb34 download face templates 2021-05-29 01:11:40 -04:00
Brandon Thomas 4a706cf5a7 improve ergonomics 2021-05-28 23:46:52 -04:00
Brandon Thomas 0924dd7cc3 download w2l model to persist dir 2021-05-28 23:31:47 -04:00
Brandon Thomas 125b60b508 builds again 2021-05-28 22:43:05 -04:00
Brandon Thomas e629166da3 filesystem path tool, tests pass again 2021-05-28 22:11:01 -04:00
Brandon Thomas 843b9755a1 two types of path 2021-05-28 21:20:48 -04:00
Brandon Thomas e2a9bf81e5 fix bug 2021-05-28 21:06:38 -04:00
Brandon Thomas 69fba14fa4 no longer fails to compile (but w2l inference is broken) 2021-05-28 21:05:49 -04:00
Brandon Thomas c11ccc36d7 WIP on w2l inference job (doesn't compile) 2021-05-28 20:32:58 -04:00
Brandon Thomas 226019b09f store metadata and mime types 2021-05-28 02:45:05 -04:00
Brandon Thomas 95b5fa8daa switch to using prefix tokens 2021-05-28 02:26:47 -04:00
Brandon Thomas abfd1a69e5 rename crockford functions, fix tests, change prefix 2021-05-28 02:16:50 -04:00
Brandon Thomas 79be37a60c upload audio to bucket 2021-05-28 02:10:30 -04:00
Brandon Thomas 3eea12e45b fix bucket length limitation 2021-05-28 01:36:54 -04:00
Brandon Thomas 5c5039c999 successful inference job creation 2021-05-28 01:26:59 -04:00
Brandon Thomas 074b985222 wip create w2l inference job 2021-05-28 01:00:36 -04:00
Brandon Thomas eecaa07638 fix/rename templates -> models 2021-05-27 19:23:00 -04:00
Brandon Thomas 5eda3a9ed3 list models 2021-05-27 19:14:41 -04:00
Brandon Thomas 6a717d386e withold reserved usernames 2021-05-27 13:56:12 -04:00
Brandon Thomas 88305f5d10 functions to check resreved usernames 2021-05-27 13:53:01 -04:00
Brandon Thomas 62b85a1166 more 2021-05-27 12:49:04 -04:00
Brandon Thomas d4800f8b62 merge lists 2021-05-27 12:47:06 -04:00
Brandon Thomas eb3c327dde another list 2021-05-27 12:46:23 -04:00
Brandon Thomas 75735ce3c7 more custom words 2021-05-27 12:44:31 -04:00
Brandon Thomas 4a8e2a00cd remove dupes 2021-05-27 12:33:08 -04:00
Brandon Thomas 21d3210f66 more custom words 2021-05-27 12:32:32 -04:00
Brandon Thomas cdc271f70a new list + few of my own 2021-05-27 12:31:15 -04:00
Brandon Thomas cfd1401b7f a few custom words 2021-05-27 12:25:26 -04:00
Brandon Thomas 6182c07d6a remove dupes 2021-05-27 12:24:13 -04:00
Brandon Thomas 571f5e8a29 combine lists 2021-05-27 12:23:07 -04:00
Brandon Thomas 6262588697 reserved db (wip) 2021-05-27 12:21:27 -04:00
Brandon Thomas 27adcb5d7f populate with lots of templates from the web 2021-05-27 12:06:07 -04:00
Brandon Thomas 363d47bcef GET template 2021-05-27 12:05:55 -04:00
Brandon Thomas 753e0edce6 list w2l templates 2021-05-27 01:47:37 -04:00
Brandon Thomas 395f3694b1 simplify bucket hashes 2021-05-27 01:12:17 -04:00
Brandon Thomas 765d4b597d record w2l file size 2021-05-27 00:56:52 -04:00
Brandon Thomas 594eb0f126 add more fields to the database 2021-05-26 22:50:47 -04:00
Brandon Thomas c0f74bad3d return gravatar with session 2021-05-26 11:11:38 -04:00
Brandon Thomas be87c4b281 add gravatar to db 2021-05-26 11:02:49 -04:00
Brandon Thomas 204e1ecd88 gravatars 2021-05-26 10:54:28 -04:00
Brandon Thomas 0d634896a1 profile endpoint 2021-05-26 02:40:28 -04:00
Brandon Thomas 3ce65d8c25 improve alpha mode enrollment 2021-05-25 03:19:20 -04:00
Brandon Thomas f536ce02cf ignore sqlx logging 2021-05-25 03:07:22 -04:00
Brandon Thomas 40f403be69 messy, but upload to PUBLIC + PRIVATE buckets 2021-05-25 03:03:52 -04:00
Brandon Thomas 1da4ab5588 fix imagemagick resize 2021-05-25 02:46:14 -04:00
Brandon Thomas 43736d01e2 get original file mimetype 2021-05-25 02:40:27 -04:00
Brandon Thomas 6b73255eae install imagemagick 2021-05-25 02:18:11 -04:00
Brandon Thomas 107f14104e imagemagick works better! 2021-05-25 02:17:29 -04:00
Brandon Thomas aa493ad197 generate preview image (fails though...) 2021-05-25 02:09:36 -04:00
Brandon Thomas 6afe1c168b save duration millis 2021-05-25 01:50:02 -04:00
Brandon Thomas 6036934dd9 looping webp 2021-05-25 01:39:20 -04:00
Brandon Thomas d45b1f6fb2 ffmpeg to generate video previews! 2021-05-25 01:27:26 -04:00
Brandon Thomas aacc6e5fb9 Read file metadata and populate DB 2021-05-25 00:54:49 -04:00
Brandon Thomas a534940509 test with video 2021-05-24 23:41:02 -04:00
Brandon Thomas fa4a43c891 notes 2021-05-24 23:39:04 -04:00
Brandon Thomas 003f35b0ba stop logspam 2021-05-24 20:21:49 -04:00
Brandon Thomas 9cdd6aa4b3 check that both files exist before upload 2021-05-24 20:10:04 -04:00
Brandon Thomas 5ea3398151 query to test 2021-05-24 19:37:32 -04:00
Brandon Thomas 46b613fef2 uploading image template processed faces works! 2021-05-24 19:37:04 -04:00
Brandon Thomas 6a07f5f91d Preprocess W2L uploads (but glitchy) 2021-05-24 19:22:40 -04:00
Brandon Thomas 066cd01dd9 remove unnecessary steps from preprocessing 2021-05-24 15:11:40 -04:00
Brandon Thomas 2727afd644 Getting ready to process W2L uploads... 2021-05-24 15:00:10 -04:00
Brandon Thomas f77563e03e major dockerfile overhaul 2021-05-24 03:40:17 -04:00
Brandon Thomas 7622c9b0e3 update gitignore 2021-05-24 03:21:31 -04:00
Brandon Thomas b2dcdbbaea add codegen cache for new queries 2021-05-24 03:21:03 -04:00
Brandon Thomas a8f969dc55 add READMEs for w2l 2021-05-24 03:19:33 -04:00
Brandon Thomas effe301d23 Add adapted Wav2Lip from https://github.com/ml-applications/wav2lip-edge 2021-05-24 03:17:53 -04:00
Brandon Thomas 4993707316 remove args that won't be used 2021-05-24 03:12:48 -04:00
Brandon Thomas 0f4d4e9cd4 add w2l command (not yet in use) 2021-05-24 03:07:08 -04:00
Brandon Thomas 0378735ac3 refactor to use shared script wrapper 2021-05-24 02:35:33 -04:00
Brandon Thomas 281283ed8b extract gdown command wrapper 2021-05-24 02:32:28 -04:00
Brandon Thomas 7e15d675b6 refactor more 2021-05-24 02:14:11 -04:00
Brandon Thomas b958b8badf refactoring 2021-05-24 02:05:47 -04:00
Brandon Thomas a4f3a06f3c refactoring 2021-05-24 01:59:27 -04:00
Brandon Thomas ab946489cf upload w2l (minus face dtection and fancy things) 2021-05-24 01:18:56 -04:00
Brandon Thomas 9aae3faab3 more common pieces 2021-05-24 00:54:04 -04:00
Brandon Thomas 5d132c8277 add more bucket stuff, w2l/tts upload jobs 2021-05-24 00:42:06 -04:00
Brandon Thomas 366bba97cb store object name 2021-05-23 13:43:50 -04:00
Brandon Thomas a7e47951e6 working path 2021-05-23 13:35:50 -04:00
Brandon Thomas c9978cecda TOKIO DOWNGRADE 1.0 -> 0.2; this fixes Bucket/S3 error 2021-05-23 13:33:01 -04:00
Brandon Thomas 50de9cfbf2 file bug report 2021-05-23 13:26:25 -04:00
Brandon Thomas 73849e825f still not working in subdirs... 2021-05-23 12:01:15 -04:00
Brandon Thomas e9ad9bbfe0 switch back to tokio, this works onlyfor non-dirs 2021-05-23 04:39:55 -04:00
Brandon Thomas 68aeded077 This upload worked (filename causes failure!) 2021-05-23 03:40:57 -04:00
Brandon Thomas 4d9fb18066 bucket uploads with correct runtime (but getting 403 forbid) 2021-05-23 02:52:26 -04:00
Brandon Thomas bf3c0c19da bucket client (but needs tokio runtime!) 2021-05-23 02:31:31 -04:00
Brandon Thomas a484207eb6 copy url 2021-05-22 09:02:02 -04:00
Brandon Thomas bb2c189c56 file hashing 2021-05-22 08:54:21 -04:00
Brandon Thomas 44d1d5bf5e update dockerfile 2021-05-22 08:18:17 -04:00
Brandon Thomas 0f366884f0 fix dockerfile ? 2021-05-22 08:04:43 -04:00
Brandon Thomas 9a9812f379 downloader works 2021-05-22 07:59:45 -04:00
Brandon Thomas 2695567ef6 closer 2021-05-22 07:52:43 -04:00
Brandon Thomas 878acbad76 forgot these queries 2021-05-22 07:37:20 -04:00
Brandon Thomas c0767a1ba1 fixup compile/remove google drive stuff 2021-05-22 07:26:37 -04:00
Brandon Thomas 11c4e78ea8 hack to install gdown and scripts in dockerfile (TODO: use venv) 2021-05-22 07:20:21 -04:00
Brandon Thomas b165996f9d use python 'gdown' to download files 2021-05-22 07:17:39 -04:00
Brandon Thomas fbf5b2513a ugh, this requires tokio runtime and hyper is inflexible 2021-05-22 05:01:13 -04:00
Brandon Thomas 09a6aa286d filesystem tempdir 2021-05-22 04:28:29 -04:00
Brandon Thomas a235aa9f88 insert tts model 2021-05-22 04:14:39 -04:00
Brandon Thomas 232f66eb69 runs jobs to exhaustion 2021-05-22 03:57:07 -04:00
Brandon Thomas b93f8a8099 progress 2021-05-22 03:49:18 -04:00
Brandon Thomas 4a3a39e5e1 Bake in job-related queries to build 2021-05-22 02:47:42 -04:00
Brandon Thomas bc1ccbc176 job can query results! 2021-05-22 02:36:10 -04:00
Brandon Thomas 5bd14c1127 4 jobs + docker builds of each 2021-05-22 01:58:59 -04:00
Brandon Thomas e154faaf32 add idempotency tokens to upload endpoints 2021-05-21 05:12:53 -04:00
Brandon Thomas ddf445701d refactor filenames 2021-05-21 00:03:18 -04:00
Brandon Thomas fa546eac05 tts inference enqueue job + test scripts 2021-05-21 00:00:35 -04:00
Brandon Thomas 235d86ca2b refactor how endpoints are grouped 2021-05-20 23:42:54 -04:00
Brandon Thomas f4437cfe0a debug scripts 2021-05-20 23:33:18 -04:00
Brandon Thomas 8c6a2c84e3 create w2l inference jobs (unchecked) 2021-05-20 23:29:28 -04:00
Brandon Thomas 4748cf6fd0 upload w2l job handler 2021-05-20 22:15:50 -04:00
Brandon Thomas 40c17a6337 create upload tts job 2021-05-20 21:53:30 -04:00
Brandon Thomas f1ac70f6fe model refinements 2021-05-20 20:22:47 -04:00
Brandon Thomas b4ce8dfaf7 model refinements 2021-05-20 20:19:59 -04:00
Brandon Thomas 23cdeaddf6 model refinements 2021-05-20 20:12:17 -04:00
Brandon Thomas 173102f1d8 more model refinements 2021-05-20 19:52:15 -04:00
Brandon Thomas 9cb3122723 model updates 2021-05-20 19:36:08 -04:00
Brandon Thomas bcc83df3bf model refinements 2021-05-20 19:24:14 -04:00
Brandon Thomas 61c583753e schema updates 2021-05-20 18:36:14 -04:00
Brandon Thomas bedfe75355 enable-alpha cookie endpoint 2021-05-20 02:35:34 -04:00
Brandon Thomas 5e434498ac configurable bind address 2021-05-20 00:32:05 -04:00
Brandon Thomas 6a04f03f32 404 route 2021-05-20 00:14:40 -04:00
Brandon Thomas 1979d604b0 index page 2021-05-20 00:07:40 -04:00
Brandon Thomas 793fd30c79 document production migrations 2021-05-19 20:49:57 -04:00
Brandon Thomas 74c67ee132 Use nativetls (production issue?) and add nginx docs 2021-05-19 20:29:57 -04:00
Brandon Thomas bdd196308b more logging 2021-05-19 01:50:25 -04:00
Brandon Thomas 15ed33d1c4 bump 2021-05-19 00:51:45 -04:00
Brandon Thomas 122f431bde fixup dockerfile 2021-05-19 00:41:14 -04:00
Brandon Thomas e0150a844a update readme with instructions 2021-05-19 00:36:41 -04:00
Brandon Thomas 7ad7437ef5 bump 2021-05-19 00:31:50 -04:00
Brandon Thomas c1fc3728c3 Add docker file 2021-05-19 00:24:32 -04:00
Brandon Thomas 29f815578f update readme 2021-05-19 00:16:26 -04:00
Brandon Thomas 498ff80a5c Cache SQLX database info so it'll build without DB 2021-05-19 00:15:35 -04:00
Brandon Thomas 06d597ebc5 .env for local dev and sqlx builds 2021-05-18 23:58:31 -04:00
Brandon Thomas d74cc614b8 cleanup 2021-05-18 23:50:48 -04:00
Brandon Thomas 0f68ce115b session state persists; using nginx as local dev proxy 2021-05-18 06:16:39 -04:00
Brandon Thomas c264f09ee2 improve session endpoint 2021-05-18 01:52:52 -04:00
Brandon Thomas 03b4e92d3a session info handler 2021-05-18 00:57:53 -04:00
Brandon Thomas 57e3fc4ebe session checker, etc. etc. 2021-05-18 00:37:41 -04:00
Brandon Thomas b7659d5b5d better script output 2021-05-17 23:42:35 -04:00
Brandon Thomas 758314093b logout endpoint and "test" 2021-05-17 23:36:57 -04:00
Brandon Thomas 80966cd876 reuse session creation 2021-05-17 22:48:49 -04:00
Brandon Thomas aa740db35b more "test" scripts 2021-05-17 22:09:01 -04:00
Brandon Thomas 245ef66969 working login 2021-05-17 22:08:48 -04:00
Brandon Thomas 0c9751bea5 test scripts in lieu of actual testing 2021-05-17 20:39:09 -04:00
Brandon Thomas 53c1ed5381 ignore diesel codegen 2021-05-17 20:33:08 -04:00
Brandon Thomas 9893737a57 hmac jwts 2021-05-17 20:31:55 -04:00
Brandon Thomas d2a75a29ec pw validations, session expiry +1 year, etc 2021-05-17 16:41:53 -04:00
Brandon Thomas 5076536e6d username validations 2021-05-17 16:00:32 -04:00
Brandon Thomas 215df96f03 ip address, duplicate record handling 2021-05-17 15:45:24 -04:00
Brandon Thomas 03eee526a0 signup wip; db writes 2021-05-17 02:28:25 -04:00
Brandon Thomas 47ead0febf random tokens 2021-05-17 02:00:31 -04:00
Brandon Thomas d0a5959e3c wip 2021-05-17 00:03:45 -04:00
Brandon Thomas e93a390a07 different shape 2021-05-16 21:44:07 -04:00
Brandon Thomas d4a4c1bc96 more example code 2021-05-16 21:12:19 -04:00
Brandon Thomas 2559b73550 singluar endpoint 2021-05-16 20:37:57 -04:00
Brandon Thomas cb3aa648e5 modules for model queries 2021-05-16 12:15:44 -04:00
Brandon Thomas 2ad5328c98 this inserts into the database! 2021-05-16 12:07:30 -04:00
Brandon Thomas 32a9949559 this version of actix/sqlx works, but uses diff runtime? 2021-05-16 11:57:29 -04:00
Brandon Thomas 0cc74fe266 This configuration works for Actix + Sqlx (older Sqlx) 2021-05-16 11:45:54 -04:00
Brandon Thomas 7d33ecd1df indices, etc 2021-05-16 10:50:24 -04:00
Brandon Thomas 938f6d15fa widen tokens 2021-05-16 10:35:54 -04:00
Brandon Thomas 63a63fa28d widen ip address columns 2021-05-16 10:16:48 -04:00
Brandon Thomas d1b7fef17c inference results 2021-05-15 18:01:32 -04:00
Brandon Thomas 6edbec3cb8 inference jobs 2021-05-15 17:46:40 -04:00
Brandon Thomas b6abf17096 rename migration 2021-05-15 17:32:21 -04:00
Brandon Thomas 3e80c8eba3 more types of tables 2021-05-15 17:31:34 -04:00
Brandon Thomas 72e9c17d50 social media profiles 2021-05-15 17:27:14 -04:00
Brandon Thomas cb505f1cb0 pk/fk/index defs 2021-05-15 17:22:17 -04:00
Brandon Thomas 7514f162ca change primary key definitions 2021-05-15 17:01:21 -04:00
Brandon Thomas 783c61d1b4 correct collations 2021-05-15 16:54:51 -04:00
Brandon Thomas b8d256d137 update readme 2021-05-15 16:45:47 -04:00
Brandon Thomas 9b8f0ce028 all migrations run 2021-05-15 16:43:38 -04:00
Brandon Thomas a733a2da0b voices table 2021-05-15 05:04:05 -04:00
Brandon Thomas ea2261c07a more schema 2021-05-15 04:48:41 -04:00
Brandon Thomas 5a94e18779 more schema work 2021-05-15 04:29:07 -04:00
Brandon Thomas b2cf2dc3eb model asset tables 2021-05-15 03:50:27 -04:00
Brandon Thomas 322895c050 Migrations WIP 2021-05-15 03:45:23 -04:00
Brandon Thomas 2cd8f28757 Actix setup, ServerState arc 2021-05-14 18:12:31 -04:00
Brandon Thomas 9ee55b6a48 gitignore 2021-05-12 11:37:03 -04:00
Brandon Thomas bb94918905 storyteller-web "monolith", base dependencies 2021-05-12 11:36:19 -04:00
Brandon Thomas 57f1dc5822 add dockerfile + GHA 2021-05-12 04:36:34 -04:00
Brandon Thomas a3ccf1cc58 switch to env-based config 2021-05-12 04:34:32 -04:00
Brandon Thomas 033c6026ad switch to env-based config 2021-05-12 03:31:40 -04:00
Brandon Thomas c14f8bddd5 new dockerfile, GHA, minor updates 2021-05-12 03:17:28 -04:00
Brandon Thomas 19ca3e6671 Redis TLS optional 2021-05-12 02:44:21 -04:00
Brandon Thomas e22cd83b15 dotenv, easyenv update, template for .env 2021-05-12 01:26:41 -04:00
Brandon Thomas ac7d4db4a3 switch to env-based config 2021-05-12 00:58:55 -04:00
Brandon Thomas fc05752ce1 logging 2021-05-12 00:19:36 -04:00
Brandon Thomas bbd758391b cleanup, comments 2021-05-11 02:38:57 -04:00
Brandon Thomas ee7d92256d notes 2021-05-11 02:36:05 -04:00
Brandon Thomas ff28b4d00e change permissions 2021-05-11 02:30:49 -04:00
Brandon Thomas cdf331cf08 login & pull 2021-05-11 02:24:09 -04:00
Brandon Thomas dd8ddaf070 change actor 2021-05-11 02:23:15 -04:00
Brandon Thomas 2b00bfbf83 try pulling 2021-05-11 02:19:22 -04:00
Brandon Thomas 59040ca240 testing another login method 2021-05-11 02:17:17 -04:00
Brandon Thomas 4a81758f79 login first before docker build 2021-05-11 02:00:40 -04:00
Brandon Thomas d483d3cc2c use base image 2021-05-11 01:57:06 -04:00
Brandon Thomas 752fd73a64 Add metadata to container 2021-05-11 00:43:06 -04:00
Brandon Thomas 92231f7ace add permissions to step 2021-05-11 00:33:16 -04:00
Brandon Thomas f559ac395e not sure this is any different... 2021-05-11 00:32:06 -04:00
Brandon Thomas 79bb1d3614 change image name, use GITHUB_TOKEN 2021-05-11 00:11:32 -04:00
Brandon Thomas 3ca18afceb GITHUB_TOKEN instead of dangerous PAT 2021-05-10 23:49:06 -04:00
Brandon Thomas 7a3e98bd6b add dockerfile / build config 2021-05-10 23:29:17 -04:00
Brandon Thomas ceaf7390c0 rename 2021-05-10 23:23:04 -04:00
Brandon Thomas 5a3faa9fb3 fix dockerfile bug, rename image 2021-05-10 23:21:23 -04:00
Brandon Thomas 91f0134283 rename app 2021-05-10 23:11:44 -04:00
Brandon Thomas 9021499f46 rename app 2021-05-10 23:11:09 -04:00
Brandon Thomas dcb66a52d5 add dockerfile 2021-05-10 22:18:28 -04:00
Brandon Thomas 4e2c18bece this builds; unsure if correct 2021-05-10 18:56:52 -04:00
Brandon Thomas 8bd0f22ff7 this builds, but isn't correct 2021-05-10 18:51:57 -04:00
Brandon Thomas ebd98a3571 fixed type issues 2021-05-10 11:31:31 -04:00
Brandon Thomas 67b750d956 Don't use Twitter user_id just yet due to signedness 2021-05-10 04:10:11 -04:00
Brandon Thomas 921435d177 more twitter fields 2021-05-10 03:51:02 -04:00
Brandon Thomas 134ff704bf Add protos submodule 2021-05-10 03:13:19 -04:00
Brandon Thomas 021213205a cleanup 2021-05-10 02:54:27 -04:00
Brandon Thomas 5c8a1730f2 these are the fields we'll use... 2021-05-10 02:51:46 -04:00
Brandon Thomas 7b9e122eb0 self-managing twitter client 2021-05-10 02:16:57 -04:00
Brandon Thomas 2787fa7d67 more data 2021-05-09 22:59:36 -04:00
Brandon Thomas 14d99b44b7 mention example 2021-05-09 15:12:06 -04:00
Brandon Thomas 59c71a82d4 This works! 2021-05-09 15:00:39 -04:00
Brandon Thomas 3d920f9791 get_ccess_token works! 2021-05-09 14:38:53 -04:00
Brandon Thomas cc20bee727 WIP, work on Twitter secrets 2021-05-09 14:21:14 -04:00
Brandon Thomas ac78cb3f75 Adapting example from egg crate + twitch-firehose (WIP) 2021-05-09 01:56:16 -04:00
Brandon Thomas ec35ad5f66 init repo 2021-05-09 00:01:42 -04:00
Brandon Thomas acaa135d0a TTS handler 2021-05-08 20:58:42 -04:00
Brandon Thomas 0adc41052b minor cleanup 2021-05-08 20:38:57 -04:00
Brandon Thomas 15f5d1ae49 cleanup, reuse functions 2021-05-08 20:38:42 -04:00
Brandon Thomas 8611273a89 spawn command handler 2021-05-08 13:12:05 -04:00
Brandon Thomas c61a069a6f fix proto field types 2021-05-08 04:18:05 -04:00
Brandon Thomas 0c4221be9f use redis client with retry for publishing 2021-05-08 03:55:34 -04:00
Brandon Thomas 69f2e2164e move clients to module 2021-05-08 03:49:10 -04:00
Brandon Thomas 876b149331 check in codegen'd protos 2021-05-08 03:44:19 -04:00
Brandon Thomas aeb547fa9c log a few things 2021-05-08 03:39:20 -04:00
Brandon Thomas 8318f615e8 Refactor and reorganization of clients, msg handling, etc 2021-05-08 00:20:49 -04:00
Brandon Thomas 8d5d0702e6 change error handling 2021-05-08 00:06:21 -04:00
Brandon Thomas 5e92b34ee6 Add codegen protos to source, makes easier to brouse in IJ 2021-05-07 23:16:48 -04:00
Brandon Thomas 4bf20681fd better retry handling 2021-05-07 22:58:15 -04:00
Brandon Thomas 31de77cfd1 cleanup 2021-05-07 22:33:47 -04:00
Brandon Thomas 71758aef4e use redis connection manager (theoretically reconnects) 2021-05-07 22:12:51 -04:00
Brandon Thomas d5a329469e fix wiring 2021-05-07 03:26:57 -04:00
Brandon Thomas 2c907b224b wire up to outbound proto 2021-05-07 03:22:49 -04:00
Brandon Thomas e96a29ed6c updated architecture 2021-05-07 03:03:22 -04:00
Brandon Thomas 8641289f43 add other proto type 2021-05-07 02:20:37 -04:00
Brandon Thomas 7a4f6fbbbf new enum type 2021-05-07 02:15:21 -04:00
Brandon Thomas 0ae823be44 more proto handling 2021-05-07 00:52:36 -04:00
Brandon Thomas 512829cb09 parse message types (wip) 2021-05-07 00:36:38 -04:00
Brandon Thomas b69f1c2a76 command parser tests pass 2021-05-06 23:59:47 -04:00
Brandon Thomas bd0d29973c add command parser and tests (wip) 2021-05-06 23:51:14 -04:00
Brandon Thomas aa7e3612f3 WIP on pubsub enricher port to better protos 2021-05-03 23:53:08 -04:00
Brandon Thomas faf4d85ac6 fix name collision 2021-05-02 19:00:14 -04:00
Brandon Thomas c620cf5b18 publish to 'firehose' by default 2021-05-02 18:52:13 -04:00
Brandon Thomas b5663347a2 Major refactor: new payload wrapper type 2021-05-02 18:15:35 -04:00
Brandon Thomas a1e931b5e8 optional types 2021-05-02 17:31:38 -04:00
Brandon Thomas 491b51939b omitted payload data 2021-05-02 17:23:49 -04:00
Brandon Thomas 367b1bbc9f huge refactor to ingestion protos 2021-05-02 17:21:26 -04:00
Brandon Thomas 0775b0f13f not necessary anymore 2021-05-02 16:31:44 -04:00
Brandon Thomas 3217f96e6f fix duplication 2021-05-02 16:10:39 -04:00
Brandon Thomas bf5f427a61 fix protos for C++ 2021-05-02 16:08:02 -04:00
Brandon Thomas 590dc6756b vastly more protos for the unreal firehose 2021-05-02 16:05:52 -04:00
Brandon Thomas 419349d429 send a debug message in the proto 2021-05-01 16:11:10 -04:00
Brandon Thomas 211239cc30 more debug messages 2021-05-01 16:09:22 -04:00
Brandon Thomas e86757d405 add debug message to payload 2021-05-01 16:08:59 -04:00
Brandon Thomas de7f23ff99 fix sending (wasn't connected) 2021-05-01 02:42:04 -04:00
Brandon Thomas 43c3d7c3b4 proto2 -> proto3 (UGH INTERFACE), sending fails(?) 2021-05-01 02:38:36 -04:00
Brandon Thomas f24ccba760 force proto3, protoc 3.6 compatible 2021-05-01 01:52:38 -04:00
Brandon Thomas 5798722724 end-to-end works 2021-04-29 20:48:32 -04:00
Brandon Thomas 6ee9e7ffdf encode payload in sub-field 2021-04-29 20:38:22 -04:00
Brandon Thomas 2b70ce61e6 build unreal proto 2021-04-29 20:34:22 -04:00
Brandon Thomas 2fcb93f60a add package to unreal protos 2021-04-29 20:11:50 -04:00
Brandon Thomas f3451c4a7b work on geocode handler (I accidentally blew away this commit) 2021-04-29 20:09:47 -04:00
Brandon Thomas 108f080920 add unreal engine protos 2021-04-29 20:04:52 -04:00
Brandon Thomas d1fb144e99 clean up lat/long parsing 2021-04-29 02:06:08 -04:00
Brandon Thomas 879fce4ef1 more tests passing 2021-04-29 02:01:53 -04:00
Brandon Thomas 39e2b74499 more passing tests 2021-04-29 01:58:46 -04:00
Brandon Thomas 75e1416383 passing test cases 2021-04-29 01:51:57 -04:00
Brandon Thomas 8ec6b8e485 parsing (but test fails) 2021-04-29 01:29:33 -04:00
Brandon Thomas 28e8f4e67c fixed dispatching, prototype handler 2021-04-29 00:49:16 -04:00
Brandon Thomas 1780c6c0cf dynamic handler map 2021-04-29 00:22:43 -04:00
Brandon Thomas 982a4ea0f6 wip dispatcher 2021-04-28 23:23:05 -04:00
Brandon Thomas c0538a2a50 use logger 2021-04-28 23:22:51 -04:00
Brandon Thomas 697942b137 use logger 2021-04-28 23:11:40 -04:00
Brandon Thomas ef937d8097 break out redis pubsub, add google geocoder crate 2021-04-28 04:49:23 -04:00
Brandon Thomas 88960124fd gitignore vim 2021-04-28 04:27:17 -04:00
Brandon Thomas 9de4d37273 gitignore vim 2021-04-28 04:26:58 -04:00
Brandon Thomas 39ba0a633c ingestion and proto decode works! now to build stuff! 2021-04-27 05:47:30 -04:00
Brandon Thomas e53a72492c pubsub-enricher: initial commit / app skeleton 2021-04-27 05:03:25 -04:00
Brandon Thomas 848eaa29fe doc about protos 2021-04-27 04:25:40 -04:00
Brandon Thomas 18861117a4 rename 'twitch-firehose' 2021-04-27 04:24:30 -04:00
Brandon Thomas a892253577 publish fuller proto 2021-04-27 03:22:55 -04:00
Brandon Thomas a3051ded47 comment 2021-04-27 03:17:23 -04:00
Brandon Thomas c31d1934c2 update protos 2021-04-27 03:12:59 -04:00
Brandon Thomas e5abaf2abf add new fields to twitchmessage (renumbered the tags) 2021-04-27 03:11:52 -04:00
Brandon Thomas 77b8887b7a Publish proto to Redis pubsub 2021-04-27 03:06:35 -04:00
Brandon Thomas 1a871b4a74 minor refactor 2021-04-27 01:57:41 -04:00
Brandon Thomas f369daf567 add storyteller protos git submodule 2021-04-26 03:17:29 -04:00
Brandon Thomas df54611572 add prost and build script, but no protos yet 2021-04-26 03:13:50 -04:00
Brandon Thomas 67e10dfe3c rename main 2021-04-26 03:01:22 -04:00
Brandon Thomas 2c8fb4be96 Initial commit; a few messages to bootstrap with 2021-04-26 02:42:35 -04:00
Brandon Thomas e8a94803b1 add hacky internal rate limiting (just sleep at 503) 2021-04-09 02:48:52 -04:00
Brandon Thomas f3998347ca more log instrumentation 2021-04-09 01:24:18 -04:00
Brandon Thomas 05e24f8efc add a bunch of debug lines to POST /speak 2021-04-09 01:15:35 -04:00
Brandon Thomas 314fe59f33 image with curl 2021-04-09 00:25:43 -04:00
Brandon Thomas e273999f5d rename file 2021-04-07 12:40:57 -04:00
Brandon Thomas 9fde197164 remote unnecessary urls; dynamic urls should work now 2021-04-05 03:42:38 -04:00
Brandon Thomas 4278e70442 this works for hosting static files 2021-04-05 03:39:53 -04:00
Brandon Thomas 21422053be dynamic URLs almost working - JS/CSS assets won't load 2021-04-05 03:17:15 -04:00
Brandon Thomas 2586d39f5f Infer early access API endpoint from URL 2021-04-05 02:04:30 -04:00
Brandon Thomas 82a47f5d27 JSON early access endpoint 2021-04-05 01:44:04 -04:00
Brandon Thomas 767d7a78e8 use easyenv, more work on "bonus voices" (WIP) 2021-04-05 01:18:22 -04:00
Brandon Thomas 4489225e74 new early acccess rewards system (WIP) 2021-04-04 23:57:21 -04:00
Brandon Thomas 4d820c82cc fix voice name 2021-04-04 21:07:37 -04:00
Brandon Thomas b6f0571836 new voices; configurable hidden access URL 2021-04-02 21:13:27 -04:00
Brandon Thomas 0e0cd92f57 move some of the 0mq stuff 2021-03-17 20:47:12 -04:00
Brandon Thomas 76a74a027e rename module 2021-03-17 20:42:05 -04:00
Brandon Thomas e460b0e407 fix env vars 2021-03-17 10:20:30 -04:00
Brandon Thomas fdb074b171 This seems to protect both sets of hidden endpoints 2021-03-17 10:00:15 -04:00
Brandon Thomas faa75eae82 greatly improved 2021-03-17 09:51:11 -04:00
Brandon Thomas f4193046e5 getting closer to done 2021-03-17 09:09:33 -04:00
Brandon Thomas 19099545cb update speaker works 2021-03-17 08:00:45 -04:00
Brandon Thomas 226b36edb5 more cleanup, shared components 2021-03-17 07:52:51 -04:00
Brandon Thomas f77560a5c6 Add mode switching buttons 2021-03-17 06:07:32 -04:00
Brandon Thomas ebd04c82a0 Port old frontend (not quite working) 2021-03-17 05:55:21 -04:00
Brandon Thomas 37ea12dbdb tts_service: multiple hosted dirs, begin work on twitch/patreon 2021-03-17 05:22:06 -04:00
Brandon Thomas 5e1c015e59 add twitch create-react-app 2021-03-17 04:18:27 -04:00
Brandon Thomas b693d31240 creating a variety of frontends now 2021-03-17 04:06:23 -04:00
Brandon Thomas d53a262a6d MJ, Tails, Knuckles 2021-03-17 04:03:42 -04:00
Brandon Thomas a679908f31 swap the endpoints (quick hack for now) 2021-03-16 21:20:14 -04:00
Brandon Thomas 417b6d599c never committed!?! 2021-03-16 20:38:31 -04:00
Brandon Thomas cab31062e2 committing just in case 2021-03-16 20:37:24 -04:00
Brandon Thomas 5c1b0687ab attempting to do multi-page builds (hack) 2021-03-16 20:35:49 -04:00
Brandon Thomas e300d7d198 early access speakers JSON endpoint + config 2021-03-16 20:07:18 -04:00
Brandon Thomas 040270422e add goku config 2021-03-15 21:27:59 -04:00
Brandon Thomas c969c4e9e3 redis error handling ?? 2021-03-09 20:20:06 -05:00
Brandon Thomas 399b7f671e add debug axes 2021-03-09 06:19:13 -05:00
Brandon Thomas 575003107f redis publishing from last night 2021-03-09 01:25:26 -05:00
Brandon Thomas 1be8f77b60 cleanup and add username to protocol 2021-03-08 05:21:43 -05:00
Brandon Thomas c25b016b0d more abstraction, cleanup 2021-03-08 04:54:18 -05:00
Brandon Thomas 1d43a86364 this should be much better and have recoverability 2021-03-08 03:54:07 -05:00
Brandon Thomas 1e461100e4 in the middle of refactoring 2021-03-08 03:42:59 -05:00
Brandon Thomas bc34817905 Move all to main 2021-03-08 03:15:35 -05:00
Brandon Thomas 6b250b81eb refactor secrets 2021-03-08 02:57:44 -05:00
Brandon Thomas 303b3aae74 uncommitted changes 2021-03-08 02:41:42 -05:00
Brandon Thomas 9405aca666 peter griffin and eric cartman 2021-03-07 23:28:13 -05:00
Brandon Thomas df3b72d460 don't use truncated sensor size 2021-03-02 00:57:32 -05:00
Brandon Thomas 856d2145cf almost there with the redis client...
Thanks random Chinese blog
https://ask.csdn.net/questions/1964104
2021-02-25 05:16:24 -05:00
Brandon Thomas 173446ccce Twitch chat integration works 2021-02-25 04:08:15 -05:00
Brandon Thomas cdd2cd1ac4 about to explore 'twitchchat' crate, but too tired to continue 2021-02-24 04:20:44 -05:00
Brandon Thomas 617359c52e This works to query the API 2021-02-24 03:57:30 -05:00
Brandon Thomas 1812d313a2 read secrets 2021-02-24 00:04:55 -05:00
Brandon Thomas 53268a3d14 First commit, nothing really here except for a lib I did DD on 2021-02-22 23:52:34 -05:00
Brandon Thomas 2f704d0795 Fix windows builds flakiness with build script to copy k4a.lib 2021-02-11 01:17:28 -05:00
Brandon Thomas 79b41f4c3b remove a lot of unused deps 2021-02-11 00:11:17 -05:00
Brandon Thomas 72bc0e4e7a move old code into _deprecated for close reference (delete later) 2021-02-10 23:52:25 -05:00
Brandon Thomas 0fb360192d Fix NaN behavior. This is for you, Juno <3 2021-02-10 23:41:01 -05:00
Brandon Thomas b129273914 left and right cull 2021-02-04 04:44:01 -05:00
Brandon Thomas 144723a120 xyz offsets 2021-02-04 02:50:33 -05:00
Brandon Thomas 1914a8fb78 fix fps/fov 2021-02-04 02:40:43 -05:00
Brandon Thomas bddbca639c cli 2021-02-04 02:37:02 -05:00
Brandon Thomas 5a436a2d43 cleanup 2021-02-04 02:24:35 -05:00
Brandon Thomas 6f850a988e updated with log messages 2021-02-04 02:00:35 -05:00
Brandon Thomas 8c6f5861a5 minor cleanup 2021-02-04 01:41:14 -05:00
Brandon Thomas bd18ed9c09 this is probably the config to go with for awhile for cam+depth 2021-02-03 03:29:06 -05:00
Brandon Thomas bbb0f91112 fix color 2021-02-03 03:01:04 -05:00
Brandon Thomas 40f0e76419 CAMERA COLOR POINT CLOUDS WORK! 2021-02-03 02:56:54 -05:00
Brandon Thomas d9b07cfabe Camera transform works (maybe!) 2021-02-03 02:12:26 -05:00
Brandon Thomas e5d33744bf add dimension check for point cloud calculation 2021-02-03 02:00:34 -05:00
Brandon Thomas 259b7f60e3 comments on resolutions 2021-02-03 01:52:59 -05:00
Brandon Thomas aaad3f64a5 functionality restored, but need to figure out dims/transform 2021-02-03 01:41:53 -05:00
Brandon Thomas 52f7de91aa WIP color camera support (currently slow and wrong dimensions) 2021-02-03 01:28:10 -05:00
Brandon Thomas 1168f94874 move color randomization functions 2021-02-02 22:49:56 -05:00
Brandon Thomas 31532633bf debugging, starting to pull commands into another module (not done) 2021-02-02 05:37:07 -05:00
Brandon Thomas a352e9450f cleanup and debugging (not capping "packets" occasionally segfaults C++) 2021-02-02 04:25:30 -05:00
Brandon Thomas 193fd8d3d6 refactor debug routines, add time-based color 2021-02-02 03:56:46 -05:00
Brandon Thomas 2b8bdf69df more colors 2021-02-02 03:28:37 -05:00
Brandon Thomas 9ce8f1837c changed color from f32 to u8 (also in C++), now it works 2021-02-02 03:06:55 -05:00
Brandon Thomas 94aa24c797 update readme 2021-02-01 22:57:07 -05:00
Brandon Thomas 71df3f80fa rename binary, add debugging 2021-01-31 23:31:19 -05:00
Brandon Thomas dc9e00f7c2 This created a NewObject, attached component, registred. It works!
(Still flickery)
2021-01-21 03:27:23 -05:00
Brandon Thomas 26dcada19d woooo 2021-01-19 05:27:42 -05:00
Brandon Thomas a88debe52d here we go!! far from perfect, but clearly depth 2021-01-19 05:10:45 -05:00
Brandon Thomas e0373ce0bb this streams, but we need to modify the protocol 2021-01-19 04:47:47 -05:00
Brandon Thomas ff6a14f4d7 This seems to read points!! 2021-01-19 04:10:29 -05:00
Brandon Thomas 82caaff720 wip 2021-01-19 04:04:08 -05:00
Brandon Thomas eaabd0ff09 update program to hypothetically send data length then data 2021-01-19 02:03:32 -05:00
Brandon Thomas 463d7b3b70 update k4a-sys-temp and kinect.rs for windows 2021-01-19 01:09:37 -05:00
Brandon Thomas 896b7fb7b9 add zeromq code from another project 2021-01-18 21:56:27 -05:00
Brandon Thomas d5e5981475 add color.rs/point.rs from zeromq project 2021-01-18 21:52:44 -05:00
Brandon Thomas f972b0d657 point cloud calculation! (haven't proven this yet) 2021-01-18 13:50:38 -05:00
Brandon Thomas c7e749a124 depth xy-table 2021-01-18 01:23:34 -05:00
Brandon Thomas f8716c5c3e multiple binaries 2021-01-17 23:57:54 -05:00
Brandon Thomas 23d10028ce remove other files that won't be used 2021-01-17 23:37:45 -05:00
Brandon Thomas d36f9e7141 remove old vendored k4a libs 2021-01-17 23:32:50 -05:00
Brandon Thomas eaaeb47831 Remove 3d object assets; program now runs again 2021-01-17 23:05:30 -05:00
Brandon Thomas 3b9ce4ff35 update to use k4a-sys-temp and kinect.rs 2021-01-17 20:46:05 -05:00
Brandon Thomas c70053bd44 update readme (k4aviewer works on my laptop now!) 2021-01-16 01:15:24 -05:00
Brandon Thomas 841e57c306 more instruction 2021-01-16 00:48:32 -05:00
Brandon Thomas 37eee321e5 set to use one camera, add Grub instructions 2021-01-16 00:25:32 -05:00
Brandon Thomas 0cd71d1626 remove opencv, update docs for install on Ubuntu 18.04 2021-01-16 00:18:42 -05:00
Brandon Thomas 51284cc6dd fork old experiments to slim down to just camera -> cloud 2021-01-15 23:54:59 -05:00
Brandon Thomas 1f576b8766 clarify 2021-01-10 22:33:58 -05:00
Brandon Thomas 405a9eb1e1 update install instructions for 20.04 2021-01-10 22:22:36 -05:00
Brandon Thomas 98e675da65 Add in patched k4a-sys library, include build instructions 2021-01-10 22:10:39 -05:00
Brandon Thomas 399487433b update speaker models 2020-10-26 03:13:52 -04:00
Brandon Thomas 6fe54011a7 revert SSL 2020-10-23 23:26:34 -04:00
Brandon Thomas 188c9e4593 put curl into final build image; less hacky (maybe?) 2020-10-23 22:55:59 -04:00
Brandon Thomas f01e14ba7b add two new voices 2020-10-23 22:14:47 -04:00
Brandon Thomas d4822d0f28 Can't call HTTP-only endpoint anymore; add error messages 2020-10-23 22:07:02 -04:00
Brandon Thomas 65117aa5ce Use FAST FAST FAST arpabet 2.0 crate 2020-10-13 06:58:59 -04:00
Brandon Thomas d8e38f091f new models 2020-10-11 02:48:50 -04:00
Brandon Thomas 7d79fcccdc six new voices (yaml configs) 2020-10-03 01:25:07 -04:00
Brandon Thomas b25608e843 Ability to force reload of model (frontend + backend) 2020-10-03 00:13:52 -04:00
Brandon Thomas 56f048ebad now it isn't responding - fix 2020-09-28 08:02:56 -04:00
Brandon Thomas 9e93bbaf0a Dampen down the responses being generated 2020-09-28 07:32:51 -04:00
Brandon Thomas 7d120dc4c8 default text 2020-09-28 06:16:12 -04:00
Brandon Thomas 1238cd3fc6 github actions 2020-09-28 05:58:35 -04:00
Brandon Thomas f8ea7759f1 add static asset, more env vars, --release 2020-09-28 05:55:44 -04:00
Brandon Thomas 0685bd640f This works! 2020-09-28 05:03:49 -04:00
Brandon Thomas 9e7b33940e Upload media 2020-09-28 04:07:26 -04:00
Brandon Thomas b8c2ba2b94 location, reply to, and don't tweet back self 2020-09-28 03:57:09 -04:00
Brandon Thomas 5c99d2ce5c Reducing workers seemed to work; (I was starving them?) 2020-09-28 03:22:08 -04:00
Brandon Thomas 3ddea5bd67 Twitter Bot: tokio and futures are hard. Not yet working 2020-09-28 03:16:35 -04:00
Brandon Thomas fcb5410663 multiple speakers and help message 2020-09-17 05:27:48 -04:00
Brandon Thomas 4cf253bec0 change order of reconfigure/reload (important) 2020-09-15 23:59:08 -04:00
Brandon Thomas 2d3aac80a7 add browser restart and driver reload scripts 2020-09-15 21:50:59 -04:00
Brandon Thomas 22f7ed7586 add endpoint to report min and max character limits 2020-09-14 02:09:10 -04:00
Brandon Thomas 90d33e70c1 add logging to launch script 2020-09-13 23:49:34 -04:00
Brandon Thomas e4ee56e0dc don't build a new response, modify the old one 2020-09-13 07:45:29 -04:00
Brandon Thomas fa05996e34 clean up response modification 2020-09-13 07:03:01 -04:00
Brandon Thomas f2b0ec1c46 add proxy hostname to response (but this isn't elegant/safe) 2020-09-13 06:37:24 -04:00
Brandon Thomas 1126803cab don't create messages on zero-length or non-200 2020-09-12 04:47:41 -04:00
Brandon Thomas 518a716c59 Add dockerfile build 2020-09-12 04:12:58 -04:00
Brandon Thomas d3d4ba2f66 cleanup 2020-09-12 03:54:27 -04:00
Brandon Thomas dbb292c0c1 First commit. Basic vocoding bot! 2020-09-12 03:34:53 -04:00
Brandon Thomas c8d875c95d per-device calibration handling (no longer distorted)
We were only using the primary device's calibration
2020-09-11 11:56:19 -04:00
Brandon Thomas 4a222ad815 realtime-voice-conversion based on last year's work
This is based on the work I did in (July - October)ish 2019 to get real
time voice conversion working. I've removed it from the `voder` library
and made it into an isolable program. I'll work on extending the
capabilities.
2020-09-11 09:06:48 -04:00
Brandon Thomas 77ad6a7e08 Broke OPTION / CORS by not matching on method 2020-09-10 05:21:03 -04:00
Brandon Thomas 8977255088 remove nightly-only build error source; remove unused imports 2020-09-10 04:54:29 -04:00
Brandon Thomas 5f02cb0df9 retry rate limit bypass; new speakers 2020-09-10 04:30:32 -04:00
Brandon Thomas df55d55b84 configurable retry limit and duration 2020-09-10 04:30:11 -04:00
Brandon Thomas e1c39e65de Robust proxying with retry
Also includes upgraded hyper-reverse-proxy, hyper, and futures.

This is looking and feeling way more ergonomic.
2020-09-10 04:18:08 -04:00
Brandon Thomas ed43e2af6e Buffered writer constrained to 1024*8 capacity 2020-09-07 00:06:05 -04:00
Brandon Thomas 08a94bccb7 new voice configurations 2020-09-06 16:38:22 -04:00
Brandon Thomas 74de16f952 if I just read the docs, I would have figured this out sooner :| 2020-09-05 00:46:17 -04:00
Brandon Thomas 625dac6c19 Move speak_proxy forwarding function into module 2020-09-05 00:37:49 -04:00
Brandon Thomas 2d3896af55 Add homer simpson 2020-08-25 22:44:29 -04:00
Brandon Thomas 66e535d96f instructions on webcam 2020-08-25 02:59:55 -04:00
Brandon Thomas 5cc08d00cc working configs from ticket in README 2020-08-25 02:49:16 -04:00
Brandon Thomas aee237d805 install script 2020-08-25 02:05:04 -04:00
Brandon Thomas d6b5cb5af0 split webcam management scripts 2020-08-25 02:00:33 -04:00
Brandon Thomas 8201760b84 script to reinstall the akvcam webcam (it's super flaky) 2020-08-25 01:43:27 -04:00
Brandon Thomas 26bce07709 add depth threshold to kinect, move cameras 2020-08-25 01:23:09 -04:00
Brandon Thomas 14c36d2745 shader cleanup 2020-08-25 01:09:05 -04:00
Brandon Thomas 543de0f785 TWO CAMERAS WORKING IN OPENGL AND SHADED 2020-08-25 00:57:41 -04:00
Brandon Thomas 978d5b2dfa cleanup render 2020-08-25 00:38:28 -04:00
Brandon Thomas 38e83beb58 holy shit it works! 2020-08-24 23:50:05 -04:00
Brandon Thomas 342a4dedbd I think I finally found a way to tell GLSL what to do 2020-08-24 23:36:28 -04:00
Brandon Thomas b1b55bed7c better positions and sizes for everything 2020-08-24 22:36:47 -04:00
Brandon Thomas 1333c1f3a1 reorient bridge 2020-08-24 22:29:13 -04:00
Brandon Thomas 9a56ca2b50 no longer rotate level 2020-08-24 22:25:01 -04:00
Brandon Thomas 0a0719be74 discard transparent pixels 2020-08-24 20:05:14 -04:00
Brandon Thomas 2f22131621 kokiri bridge level 2020-08-24 20:02:41 -04:00
Brandon Thomas 7a08b772ca texture transparency 2020-08-24 19:47:59 -04:00
Brandon Thomas db492449c2 add n64 zelda poe 2020-08-24 19:45:34 -04:00
Brandon Thomas 5a6a1c2d28 just needed to flip the texture 2020-08-24 18:27:01 -04:00
Brandon Thomas 0d0feadc47 checkerboard test 2020-08-24 18:16:20 -04:00
Brandon Thomas b36895a81b move models; add kingo dodongo; add logging 2020-08-24 16:56:31 -04:00
Brandon Thomas 82eeeaacd4 fixing k4a-sys updated some stuff in the background 2020-08-24 16:10:32 -04:00
Brandon Thomas fbbbbfa677 add pichu model+texture 2020-08-24 04:04:51 -04:00
Brandon Thomas 650e106385 cleanup 2020-08-24 04:03:22 -04:00
Brandon Thomas 93b790fe8e Textures kind of work... 2020-08-24 02:07:50 -04:00
Brandon Thomas 4c33046f1f rotate models 2020-08-24 01:03:00 -04:00
Brandon Thomas 7679ca4e5b flip the objects to face the camera 2020-08-24 00:41:37 -04:00
Brandon Thomas 23038489bb multiple image texture formats (rgba,rgb) 2020-08-23 13:56:00 -04:00
Brandon Thomas f1e65c5509 Texture coords! They're broken, but the brokenness looks cool 2020-08-23 13:42:58 -04:00
Brandon Thomas dbc81c4816 Organize OpenGL MVP matrix stuff a bit 2020-08-23 02:59:54 -04:00
Brandon Thomas b8addae3e0 Multiple renderable objects 2020-08-23 02:49:09 -04:00
Brandon Thomas ce7c409259 rotation works (but is messy!) 2020-08-22 05:01:48 -04:00
Brandon Thomas fb297ecd1b scaling, cleanup 2020-08-22 04:47:30 -04:00
Brandon Thomas 514fb08ff1 more ergonomic uniform 2020-08-22 04:36:29 -04:00
Brandon Thomas f461cbf2b9 more typesafe uniforms 2020-08-22 04:33:01 -04:00
Brandon Thomas b4fbf635d0 model transformation works! 2020-08-22 04:24:25 -04:00
Brandon Thomas e17a902560 positionable object (transformation mat fails) 2020-08-22 03:47:42 -04:00
Brandon Thomas 62baa3b210 rust2018 edition; work starting on matrix math 2020-08-22 03:02:23 -04:00
Brandon Thomas 70af17ded0 object work, before matrix stack 2020-08-22 02:38:42 -04:00
Brandon Thomas 3f143011a0 break out renderableobject as its own thing 2020-08-20 23:51:25 -04:00
Brandon Thomas 07335a75ff Render Yoshi model 2020-08-20 03:18:37 -04:00
Brandon Thomas a435565a04 Introduce obj loader (not yet working) 2020-08-19 13:39:12 -04:00
Brandon Thomas cdbdf77f15 Lots of cleanup... following graphics4363 2020-08-18 03:19:42 -04:00
Brandon Thomas f95b76c893 rename to disambiguate 2020-08-18 02:24:25 -04:00
Brandon Thomas b0ecc38308 split opengl wrapper structs into their own files 2020-08-18 02:22:51 -04:00
Brandon Thomas 24b05ce2c4 lots of changes to binding orders; no progress 2020-08-18 02:11:18 -04:00
Brandon Thomas 5e03a52547 IMPROVEMENT! Now both geos shaded by one color 2020-08-18 01:35:28 -04:00
Brandon Thomas a3a1825014 just experimenting... 2020-08-16 21:10:03 -04:00
Brandon Thomas 826d419c34 option to save frames 2020-08-16 15:39:25 -04:00
Brandon Thomas eb1144d197 command line to turn on and off options 2020-08-16 05:11:09 -04:00
Brandon Thomas 762e839a57 No longer need to start cameras! 2020-08-16 04:47:20 -04:00
Brandon Thomas 68d3e4dc39 working intrinsics/extrinsics ! 2020-08-16 04:30:24 -04:00
Brandon Thomas 8016a4d24d wrap k4a calibration 2020-08-16 03:40:34 -04:00
Brandon Thomas 2b7bbe61aa Fake Capture Proxy Works! + debug tools 2020-08-16 02:52:55 -04:00
Brandon Thomas bccefd55ed FakeDeviceCapturer, wrapper additions; new path fails, but old works 2020-08-16 02:25:31 -04:00
Brandon Thomas 9725876300 proxy fully plumbed through 2020-08-16 00:51:52 -04:00
Brandon Thomas 4c0183801a fix bug with CaptureProxy 2020-08-16 00:31:07 -04:00
Brandon Thomas 274394c235 cleanup CaptureProxy k4a::Capture consumption 2020-08-15 23:46:51 -04:00
Brandon Thomas d450a82a37 more internal usage 2020-08-15 23:28:06 -04:00
Brandon Thomas 87d4a19aee more ImageProxy usage 2020-08-15 23:22:17 -04:00
Brandon Thomas 50f5689330 more internal ImageProxy usage 2020-08-15 23:13:26 -04:00
Brandon Thomas 14a480faa1 use ImageProxy more internally 2020-08-15 23:01:26 -04:00
Brandon Thomas fb78650fbb rename awkward CameraImageBytes to ImageProxy 2020-08-15 22:54:15 -04:00
Brandon Thomas 67c5c345c2 Further work on wrapping (may not compile, this is half of my changes) 2020-08-15 22:30:27 -04:00
Brandon Thomas 68ea871c9f move up the stack 2020-08-15 20:35:31 -04:00
Brandon Thomas 04621392d6 completely static depth and color buffers 2020-08-15 19:54:35 -04:00
Brandon Thomas 0d3f67691d write both color and depth images to file 2020-08-15 19:34:14 -04:00
Brandon Thomas e33bed276a extract point cloud compute shader; share file ops 2020-08-15 18:28:25 -04:00
Brandon Thomas 3731462d77 reduce duplication between static and from-camera color images 2020-08-15 17:58:47 -04:00
Brandon Thomas 436cb7fa8a use static color frame data instead of from camera 2020-08-15 17:34:27 -04:00
Brandon Thomas 20f9f6535c write color frames to disk 2020-08-15 16:56:59 -04:00
Brandon Thomas 3f3a207040 pull out link_program 2020-08-15 16:16:19 -04:00
Brandon Thomas 793178b8b6 both cameras won't render. ugh 2020-08-15 15:53:58 -04:00
Brandon Thomas c7f87e2e3d Read in shaders from files 2020-08-15 15:46:12 -04:00
Brandon Thomas cf0ee7a543 location seems to be needed in shaders 2020-08-15 15:36:41 -04:00
Brandon Thomas cad9d76da6 both cameras correctly render INDEPENDENTLY 2020-08-15 15:08:49 -04:00
Brandon Thomas 20a8be8375 much easier to see now... 2020-08-15 01:32:13 -04:00
Brandon Thomas 3319d32256 cycle between two cameras 2020-08-15 01:20:37 -04:00
Brandon Thomas 7352f3f6d2 cleanup; pink was due to missing "layout(location=10)" 2020-08-14 04:01:30 -04:00
Brandon Thomas adb6f45fd3 the other geo is pink!?! 2020-08-13 21:20:31 -04:00
Brandon Thomas f367fd1e74 setup before testing 2020-08-13 20:50:22 -04:00
Brandon Thomas 5fcee17554 more comments on debugging (multiple colorings still not working) 2020-08-13 15:43:37 -04:00
Brandon Thomas 5e47aece53 experimental results recorded to comment 2020-08-13 03:32:27 -04:00
Brandon Thomas f5b8af9d07 interesting bug that textures both cameras, but only from one source 2020-08-13 03:09:25 -04:00
Brandon Thomas 491ea637bd notes, cleanup 2020-08-13 01:35:03 -04:00
Brandon Thomas 35b08c6f5b add spongebob 2020-08-12 18:58:26 -04:00
Brandon Thomas a8c53c0954 add grapheme_to_phoneme for OOV support 2020-08-09 15:41:11 -04:00
Brandon Thomas 2021285227 add new speakers 2020-08-05 05:00:06 -04:00
Brandon Thomas 6c66da2964 add logging to attributes 2020-08-05 01:10:08 -04:00
Brandon Thomas 43599c2a02 add newrelic attribute for speaker 2020-08-05 00:45:56 -04:00
Brandon Thomas 47f4f75eb5 build newrelic libs 2020-08-04 23:36:01 -04:00
Brandon Thomas 6bd56aad75 add newrelic logging capability 2020-08-04 22:26:30 -04:00
Brandon Thomas 6090f56b2c updatd models from last week 2020-08-02 04:10:54 -04:00
Brandon Thomas bb98218e55 add to /speak 2020-08-02 03:29:20 -04:00
Brandon Thomas 7058d77889 cleanup of stats recorder 2020-08-02 03:26:12 -04:00
Brandon Thomas d498aa5d76 cleanup, remove actors 2020-08-02 03:11:24 -04:00
Brandon Thomas 191cdc8158 This works! Async updates 2020-08-02 02:37:10 -04:00
Brandon Thomas 01158a8529 actix background actor works! 2020-08-02 01:03:19 -04:00
Brandon Thomas 1ff11a46fc This works! 200s from the other microservice 2020-08-02 00:27:45 -04:00
Brandon Thomas 8d28402172 embedded http client - this seems to work! 2020-08-02 00:13:13 -04:00
Brandon Thomas 5f15bba160 tts_frontend: retain text between speaker/spectrogram modes 2020-07-25 22:37:36 -04:00
Brandon Thomas 2eabd03b48 REMOVE DEPRECATED CODE/FILES, SUCH AS VOICE CONVERSION 2020-07-25 22:19:20 -04:00
Brandon Thomas ad23fe0c80 move project to new 'voice' directory 2020-07-25 21:40:42 -04:00
Brandon Thomas 933a4f4c26 hacky racial slur ban list 2020-07-24 10:58:44 -04:00
Brandon Thomas e0cafae746 add nine new speakers 2020-07-24 04:46:36 -04:00
Brandon Thomas 6cfd5a54eb Made database connection optional 2020-07-24 01:30:57 -04:00
Brandon Thomas 174843c7ed better rate limiter configuration 2020-07-24 00:37:40 -04:00
Brandon Thomas 73935076f8 both speak endpoints speak json errors 2020-07-23 22:08:59 -04:00
Brandon Thomas b708fa0d1f share request and error response; turn error responses to json 2020-07-23 22:04:04 -04:00
Brandon Thomas a1af6c6c5d bypass rate limit with 'limitless' header 2020-07-23 20:28:38 -04:00
Brandon Thomas 7c71835043 put all TTS endpoints in same module 2020-07-23 20:09:07 -04:00
Brandon Thomas bb0431fa0f remove unused deps 2020-07-23 19:51:14 -04:00
Brandon Thomas 471be6b8a9 refactor IP address into common 2020-07-23 19:47:34 -04:00
Brandon Thomas aabdaac3fd no-op rate limiter 2020-07-22 13:47:38 -04:00
Brandon Thomas 50fdb15fd2 reasonable blocking rate limiter 2020-07-22 13:27:19 -04:00
Brandon Thomas 58e9f58a49 this appears to work, but something is up with the timeout 2020-07-22 13:11:06 -04:00
Brandon Thomas 312593d897 this captures everything 2020-07-22 12:35:36 -04:00
Brandon Thomas 7087320cdf wip redis rate limiting 2020-07-22 12:24:52 -04:00
Brandon Thomas 8ee0e50ea1 add a lot of new speakers 2020-07-20 03:49:47 -04:00
Brandon Thomas c504b1dd33 Add reagan and attenborough 2020-07-11 05:45:25 -04:00
Brandon Thomas a72aa93ad2 Enable arpabet extensions to extend CMUdict 2020-07-08 17:11:10 -04:00
Brandon Thomas d844592a65 update speakers to use latest melgan 2020-07-01 23:04:31 -04:00
Brandon Thomas 3efb517b77 use new melgan for speakers 2020-07-01 22:56:06 -04:00
Brandon Thomas 5ad1b1b432 set sample rate for all speakers not using default 2020-07-01 22:41:19 -04:00
Brandon Thomas ee9a0c1552 Fix pitch issues. Most models need 22050, melgan's default 2020-07-01 22:38:50 -04:00
Brandon Thomas 0877e13cb9 log url for downloading 2020-07-01 21:39:35 -04:00
Brandon Thomas aeb905357e this should finally report the correct IP 2020-07-01 06:08:06 -04:00
Brandon Thomas 6aef89c6ef debug by printing all headers 2020-07-01 05:46:04 -04:00
Brandon Thomas 9730d31a60 Handle custom forwarded IP header, but preserve native IP handling 2020-07-01 05:15:41 -04:00
Brandon Thomas c7aba90ee9 custom forwarded-for type header 2020-07-01 04:53:43 -04:00
Brandon Thomas 97fbd58bb7 testing the headers; can't find remote IP 2020-07-01 04:17:16 -04:00
Brandon Thomas 4c5d096db7 add debugging for headers: forwarded,x-forwarded-for 2020-07-01 03:43:18 -04:00
Brandon Thomas 4c1be4faef add latest production models 2020-07-01 03:39:22 -04:00
Brandon Thomas e7025d035f confirmed this is correct; no longer need to log 2020-07-01 03:38:16 -04:00
Brandon Thomas 0fda9f97c3 cleanup stale comments, add debug statement for IP 2020-07-01 03:22:57 -04:00
Brandon Thomas ae060729dc add proxy healthcheck endpoint 2020-06-30 06:51:35 -04:00
Brandon Thomas 801304adde bind 0.0.0.0 2020-06-30 06:21:36 -04:00
Brandon Thomas 7e4d5f375d add debugging to catch-all route 2020-06-30 06:10:20 -04:00
Brandon Thomas 8052f3d5a1 change model keys 2020-06-30 04:13:01 -04:00
Brandon Thomas d98a41a721 rearrange model file 2020-06-30 04:11:20 -04:00
Brandon Thomas 850401fafa add dev and prod model paths 2020-06-30 03:56:35 -04:00
Brandon Thomas b9078063b3 add gilbert gottfried configs 2020-06-30 02:40:06 -04:00
Brandon Thomas 36c1c0f007 greatly simplify model config 2020-06-30 02:21:07 -04:00
Brandon Thomas 7455e51148 populate 'forwarded' header as well 2020-06-30 00:11:42 -04:00
Brandon Thomas 4a5ec4bdba add proxy config to docker, fix IP x-forwarded-for 2020-06-29 23:56:26 -04:00
Brandon Thomas b50f84c280 always fall back to default host 2020-06-29 22:59:05 -04:00
Brandon Thomas e850941f40 Working proxy design 2020-06-29 22:54:05 -04:00
Brandon Thomas 96e900457e cleanup default routing 2020-06-29 20:12:07 -04:00
Brandon Thomas 8238977553 Copy entire body too, and remove header hack 2020-06-29 20:02:32 -04:00
Brandon Thomas b268d98b86 cleanup 2020-06-29 19:42:32 -04:00
Brandon Thomas 649623c39f more efficient header copy 2020-06-29 19:32:57 -04:00
Brandon Thomas 56f707e89b copy (most) headers 2020-06-29 19:29:16 -04:00
Brandon Thomas 48a3e831ea refactor proxying (works!) 2020-06-29 18:58:56 -04:00
Brandon Thomas c89569aa8e Proxying works! 2020-06-29 15:21:20 -04:00
Brandon Thomas cd68e43389 cleanup (still need to pass original request) 2020-06-29 14:56:22 -04:00
Brandon Thomas 663284df87 This decodes the request successfully! 2020-06-29 07:07:19 -04:00
Brandon Thomas 0e2990ee2c This compiles, but isn't logical 2020-06-29 07:03:11 -04:00
Brandon Thomas 09ed0163af WIP: Futures not working 2020-06-29 06:55:24 -04:00
Brandon Thomas aa7345be2d Proxy OPTIONS header 2020-06-29 05:09:22 -04:00
Brandon Thomas 6396b6a690 configure port 2020-06-29 04:24:54 -04:00
Brandon Thomas f6619e5fef add proxy_configs.toml (unread currently) 2020-06-29 04:06:28 -04:00
Brandon Thomas 97d9490f2f deployment for a service-based setup 2020-06-29 03:00:29 -04:00
Brandon Thomas 67d094d38e screw it, install curl with apt 2020-06-29 02:35:39 -04:00
Brandon Thomas dce95dea18 all the libs 2020-06-29 02:24:19 -04:00
Brandon Thomas fc50a06e7f another curl dep 2020-06-29 02:19:24 -04:00
Brandon Thomas 4e97688e9b fix libcurl src 2020-06-29 02:08:10 -04:00
Brandon Thomas 461db14259 Add curl in final image 2020-06-29 01:55:43 -04:00
Brandon Thomas de5a5b0783 Add github workflow and dockerfile 2020-06-29 00:55:15 -04:00
Brandon Thomas d4853707c7 Testing routing 2020-06-29 00:24:14 -04:00
Brandon Thomas 9ec8010f10 updates to model configs 2020-06-29 00:06:45 -04:00
Brandon Thomas 97e94d9e56 This proxy works! 2020-06-28 23:44:16 -04:00
Brandon Thomas 28fee8eee7 initial commit 2020-06-28 22:23:48 -04:00
Brandon Thomas ac3d407c35 DB migration: widen the speaker column 2020-06-24 06:37:42 -04:00
Brandon Thomas 60211d6df6 analytic /words endpoint 2020-06-23 02:52:11 -04:00
Brandon Thomas 5bb81303c2 log database insertion errors 2020-06-23 02:23:21 -04:00
Brandon Thomas 3a5b45f5ce new deployed model; changed size of k8s replicaset 2020-06-23 01:03:56 -04:00
Brandon Thomas 6e76f37552 fixed deployment and deployed models 2020-06-22 05:45:06 -04:00
Brandon Thomas 8004011d29 change model toml files 2020-06-22 05:26:23 -04:00
Brandon Thomas 74d8d1d90c stupid numerics bug for glow tts 2020-06-22 02:27:50 -04:00
Brandon Thomas e44198428c sort headers 2020-06-22 02:16:24 -04:00
Brandon Thomas afea8746e2 finally compiles 2020-06-22 02:11:46 -04:00
Brandon Thomas c559fb74ae moved mountains, but now there's Sized to deal with 2020-06-22 01:53:39 -04:00
Brandon Thomas 6a2748b9b3 pipeline work (doesn't compile) 2020-06-22 00:45:21 -04:00
Brandon Thomas 9e2a63b17d pipeline integrated into /spectrogram_speak endpoint 2020-06-21 07:38:07 -04:00
Brandon Thomas 01b38aeb99 Add second pipeline 2020-06-21 07:20:48 -04:00
Brandon Thomas 49551168af pipeline has end-to-end inference in place 2020-06-21 07:14:22 -04:00
Brandon Thomas 80dc4d3853 wip: this should be the pipeline structure 2020-06-21 06:37:37 -04:00
Brandon Thomas 5ec1395b82 WIP almost there... trait objects have lifetime 2020-06-21 06:33:48 -04:00
Brandon Thomas 1c37e79e12 WIP: model pieces into the pipeline 2020-06-21 06:11:19 -04:00
Brandon Thomas 139805c606 WIP: Even closer 2020-06-21 06:04:13 -04:00
Brandon Thomas c31dea17e5 WIP getting closer 2020-06-21 05:56:51 -04:00
Brandon Thomas 9b3366c70c WIP: Still setting this pipeline up 2020-06-21 05:52:13 -04:00
Brandon Thomas 9883dc0d53 WIP: Still working on pipeline lifetimes 2020-06-21 05:45:30 -04:00
Brandon Thomas 3353aed5ff WIP: pipeline system, complex lifetime and box traits 2020-06-21 04:22:25 -04:00
Brandon Thomas 82240cb605 add colormaps from matplotlib 2020-06-19 23:49:37 -04:00
Brandon Thomas f300f3e61b flip spectrogram 2020-06-17 03:16:55 -04:00
Brandon Thomas fee33c4179 beautiful spectrogram 2020-06-17 03:08:31 -04:00
Brandon Thomas 72b0c94971 hacky spectrograms! 2020-06-17 02:32:31 -04:00
Brandon Thomas f87592bfc3 New endpoint to return base64 spectrogram + audio 2020-06-17 01:35:34 -04:00
Brandon Thomas a908c43660 voices in multi-voice model 2020-06-15 02:33:41 -04:00
Brandon Thomas 90a15366b3 support for multi-speaker glow-tts models (broken in tensor dims) 2020-06-15 00:33:45 -04:00
Brandon Thomas 42f51ecd18 add vo.codes to CORS allow hosts 2020-06-14 17:25:23 -04:00
Brandon Thomas 0281e206db second attempt at iphone content-range fix 2020-06-09 19:20:01 -04:00
Brandon Thomas 898e32db05 SHA with iOS headers; but it didn't work 2020-06-08 03:59:17 -04:00
Brandon Thomas 078f2183b1 headers to make iOS Safari work (maybe?) 2020-06-08 03:39:29 -04:00
Brandon Thomas 985e5e3549 min-width is too wide for mobile 2020-06-07 19:11:44 -04:00
Brandon Thomas 478980e64b per page increase 2020-06-07 19:06:21 -04:00
Brandon Thomas 1272891e9c sentence table: wider, variable height 2020-06-07 18:54:45 -04:00
Brandon Thomas 93d1d27879 How did I never check this in?! I hate VSCode sometimes 2020-06-07 18:50:40 -04:00
Brandon Thomas a0f5c1987e update post /speak endpoint to record to database 2020-06-07 07:03:39 -04:00
Brandon Thomas 5701b816a1 downloader debugging, pod scale experiments 2020-06-05 20:22:39 -04:00
Brandon Thomas 58ec25e3aa fix env logger 2020-06-05 19:23:27 -04:00
Brandon Thomas 41334b1ee5 add some tests 2020-06-05 19:06:56 -04:00
Brandon Thomas f060397402 more debugging statements 2020-06-05 18:55:59 -04:00
Brandon Thomas 2975473320 replace tabs (ugh, gross) 2020-06-05 18:45:54 -04:00
Brandon Thomas 65cc9922cd add warning 2020-06-05 18:44:35 -04:00
Brandon Thomas b8905d7f48 deployed version with new mumble.stream frontend 2020-06-05 00:32:17 -04:00
Brandon Thomas b76c294159 comments for cleanup 2020-06-05 00:06:54 -04:00
Brandon Thomas 39270bca4b working (albeit messy) modal UI with speaker,advanced,sentence modes 2020-06-05 00:03:25 -04:00
Brandon Thomas 0e599b1748 modal UI (WIP, speaker/advanced broken) 2020-06-04 23:58:39 -04:00
Brandon Thomas e039516954 sentence table component 2020-06-04 23:25:04 -04:00
Brandon Thomas c5db0e4734 sentences API: pagination direction 2020-06-04 23:24:21 -04:00
Brandon Thomas b0009596bf playable table data 2020-06-04 22:54:40 -04:00
Brandon Thomas 9568b8333b sentence endpoint is paginated now 2020-06-04 22:34:59 -04:00
Brandon Thomas e0d10496c3 new CORS localhost ports, new CORS headers 2020-06-04 20:35:17 -04:00
Brandon Thomas 2fc7d23fb9 new memory limit seems to support larget sentences, 2020-06-04 19:24:02 -04:00
Brandon Thomas a90f4b669a add hostname to response 2020-06-04 19:12:04 -04:00
Brandon Thomas dc5ec801bf updated models 2020-06-04 19:03:27 -04:00
Brandon Thomas abd1772c65 the new model; also changed request/limits 2020-06-04 13:56:42 -04:00
Brandon Thomas 6fd42e529c Ugh, this works. This is growing hard to configure 2020-06-04 03:51:34 -04:00
Brandon Thomas 7c2aeca5d2 fix 2020-06-04 03:12:56 -04:00
Brandon Thomas 6f6101fa77 Arpabet scheme works 2020-06-04 01:10:14 -04:00
Brandon Thomas 96a5ee4dab This _almost_ works. I need to encode straight to i64 2020-06-04 00:35:57 -04:00
Brandon Thomas a6af26b4df holy shit that worked 2020-06-03 20:06:20 -04:00
Brandon Thomas 9922e5a913 GlowTTS; almost working - forward() needs multiple args 2020-06-03 00:59:58 -04:00
Brandon Thomas acd0203177 move model configs under model/ 2020-06-03 00:05:14 -04:00
Brandon Thomas 2bafa7cec0 sort sentences desc, increase limit to 1000 2020-06-01 02:19:06 -04:00
Brandon Thomas 66bf126639 new melgan added! it sounds awesome 2020-06-01 01:48:14 -04:00
Brandon Thomas 6e0767bb9d min/max character length 2020-06-01 01:45:16 -04:00
Brandon Thomas a671a66b39 begin work on text cleaners 2020-05-31 22:39:47 -04:00
Brandon Thomas 0ce7baaa0b new IP address scheme 2020-05-31 22:11:26 -04:00
Brandon Thomas 306f78b762 deployment with working database 2020-05-31 22:03:49 -04:00
Brandon Thomas d83cd11aaf This should fix all the linker errors 2020-05-31 21:42:18 -04:00
Brandon Thomas ea184a452c fix dockerfile ? 2020-05-31 21:07:47 -04:00
Brandon Thomas bf55a77079 Copy mysqlclient libs 2020-05-31 20:53:35 -04:00
Brandon Thomas 7de69b8cbd dockerfile needs libmysqlclient-dev 2020-05-31 20:24:54 -04:00
Brandon Thomas 488a9739f9 cleanup internal env vars 2020-05-31 20:11:19 -04:00
Brandon Thomas 2e622de648 make db configurable 2020-05-31 20:08:19 -04:00
Brandon Thomas 83a4bb919d rust warnings cleanup 2020-05-31 20:04:33 -04:00
Brandon Thomas a862124dc5 LIMIT on sentences query 2020-05-31 19:49:50 -04:00
Brandon Thomas 2cc5ea67ba Endpoint to serve sentences as JSON 2020-05-31 19:39:03 -04:00
Brandon Thomas 3c1bc0b1a8 include speaker 2020-05-31 18:27:19 -04:00
Brandon Thomas bf68ebba34 Added database and ability to record sentences 2020-05-31 18:03:44 -04:00
Brandon Thomas 17091b4b44 deployment: set num workers and downloader sleep 2020-05-31 01:43:05 -04:00
Brandon Thomas 243d16b7f1 add mumble.stream to CORS allow 2020-05-31 01:40:11 -04:00
Brandon Thomas d61138cd10 add log line 2020-05-31 01:09:34 -04:00
Brandon Thomas 7e81c76c82 add sleep parameter and comment about hash inequality 2020-05-31 01:05:57 -04:00
Brandon Thomas 64419fa64e add secrets config 2020-05-31 00:48:42 -04:00
Brandon Thomas 62754920cb guranteed QoS for deployment 2020-05-31 00:45:12 -04:00
Brandon Thomas 4317bab01a num workers arg, refactor arg parsing 2020-05-31 00:30:20 -04:00
Brandon Thomas 565519867d Fix hash comparison, more logging 2020-05-30 22:57:18 -04:00
Brandon Thomas e87eed7b8a Add more logging 2020-05-30 22:29:23 -04:00
Brandon Thomas 68ae78516d deployment: downloader that acts as a job 2020-05-30 22:09:15 -04:00
Brandon Thomas bf957be07b add more logging to model loading 2020-05-30 21:42:15 -04:00
Brandon Thomas c8eeb91a20 Make further use of logger 2020-05-30 21:28:38 -04:00
Brandon Thomas 51e182708d change error message to distinguish 2020-05-30 20:40:40 -04:00
Brandon Thomas 9a1e7b52e0 Add launch file 2020-05-30 20:33:56 -04:00
Brandon Thomas 906f0b4b67 Deployment with do_spaces_downloader 2020-05-30 20:09:05 -04:00
Brandon Thomas 40349c08da Include SSL certs with build 2020-05-30 19:24:27 -04:00
Brandon Thomas 7a27c2eff3 docker build 2020-05-30 16:25:01 -04:00
Brandon Thomas a9313b0ff0 Initial version 2020-05-30 15:22:01 -04:00
Brandon Thomas 5a7886520a prevent segfaulting by serializing tacotron access
uses a non-blocking mutex acquire, with up to 500 milliseconds of retry
2020-05-29 01:42:39 -04:00
Brandon Thomas 44465a9c76 bump actix workers, move old_model, run segfault experiment 2020-05-29 01:23:30 -04:00
Brandon Thomas 81a96f73c8 better error messages 2020-05-28 23:16:51 -04:00
Brandon Thomas c7672af5cd defaults for required env vars; webserver index.html 2020-05-28 22:42:51 -04:00
Brandon Thomas 25220a1309 comments 2020-05-28 03:44:44 -04:00
Brandon Thomas bbb6487b98 this deployment works and turns off logspam 2020-05-27 23:54:34 -04:00
Brandon Thomas 7452be9b1c This change to deployment.yaml results in 3 healthy nodes 2020-05-27 23:48:26 -04:00
Brandon Thomas b496e0b0b0 no liveness probe, tweaked readiness probe 2020-05-27 22:01:52 -04:00
Brandon Thomas efb054d2f7 Better tts error handling (but needs logging) 2020-05-27 22:01:34 -04:00
Brandon Thomas 573aa9f4ca cleanup pods in all namespaces except loki/graphana 2020-05-27 21:38:00 -04:00
Brandon Thomas b4dd56b65c Add hostname to logs 2020-05-27 20:35:52 -04:00
Brandon Thomas 31689ec97e no longer log tensors 2020-05-27 20:27:13 -04:00
Brandon Thomas 2984c1786b Fix legacy API to require speaker and text
Early out if not present
2020-05-27 20:15:04 -04:00
Brandon Thomas 2dcc4e5896 no longer log /liveness and /readiness (logspam) 2020-05-27 20:08:37 -04:00
Brandon Thomas fd91d303b2 deployment: stop s3fs logging for graphana 2020-05-27 19:49:16 -04:00
Brandon Thomas 9cd7e56651 Pod cleanup script (ugh, this is gross) 2020-05-27 18:48:53 -04:00
Brandon Thomas 4eb1b3e79b increase replicas to 5, wrap in launch script 2020-05-27 15:10:54 -04:00
Brandon Thomas 7e4d663f73 Add launch script to manage in-container restarts 2020-05-27 14:49:10 -04:00
Brandon Thomas 9e092eee4a updated deployed_models.yaml 2020-05-27 04:29:22 -04:00
Brandon Thomas d584527187 deployed models yaml 2020-05-27 04:26:08 -04:00
Brandon Thomas 6b89620b3c Add endpoint to handle legacy GET requests from the old frontend 2020-05-27 04:11:21 -04:00
Brandon Thomas 9003eb5c16 better errors 2020-05-27 01:46:01 -04:00
Brandon Thomas 694d869cd4 Update frontend to work in different (autodetected) envs 2020-05-27 01:41:03 -04:00
Brandon Thomas 9fedbcd967 refactor frontend into directories by mode 2020-05-27 00:23:13 -04:00
Brandon Thomas 3ce772cd80 Modal test frontend can hit /speak or /advanced_tts 2020-05-27 00:17:10 -04:00
Brandon Thomas ac1a9281d4 CORS, logger 2020-05-26 22:46:22 -04:00
Brandon Thomas d4b1fa93b1 Add CORS allow list 2020-05-26 22:21:09 -04:00
Brandon Thomas 450c4ebe0a Add /speak and /speakers endpoints 2020-05-26 20:57:40 -04:00
Brandon Thomas 0652199e8a ignore models and wav files 2020-05-26 20:37:55 -04:00
Brandon Thomas a20a7259b5 beef up module config: shared base dir, speakers 2020-05-26 20:36:08 -04:00
Brandon Thomas 805bad97c3 server code cleanup, cache model configs 2020-05-26 06:15:59 -04:00
Brandon Thomas 729bdefdbc Updated deployment 2020-05-26 05:37:25 -04:00
Brandon Thomas dafe174dc3 Repair dockerfile: needs libtorch 1.5; update symlinks 2020-05-26 02:52:05 -04:00
Brandon Thomas d3a0a30884 tts_service: specify model config file by env var 2020-05-26 01:15:58 -04:00
Brandon Thomas 0a70b326e7 Kind of stuck, now. Rendering red and blue point clouds
- Color information from second camera only gets through if first camera
is disabled.

- How do I print BOTH point clouds from uniform data?
2020-05-18 04:47:45 -04:00
Brandon Thomas 6141c453fd two point clouds translated on the x-axis 2020-05-18 01:07:33 -04:00
Brandon Thomas d7d52485d7 two point clouds! (gl_VertexID-interleaved rendering) 2020-05-18 01:01:15 -04:00
Brandon Thomas 983d301554 getting somewhere, but this is confusing.
Changing textures in the point_cloud_renderer GLSL to be either index 0
or 1 (pointCloudTexture0 or pointCloudTexture1, each corresponding to a
camera) to the opposite of the skip block in the loop on line 611 will
show a perfect shaded image from the non-skipped camera.

This suggests that both cameras are sending texture and color data.
However...

Trying to do a linear combination from non-skipped color data is WEIRD
though, and not as I'd expect.
2020-05-18 00:47:55 -04:00
Brandon Thomas 56b4271295 Something interesting going on.
- Both inputs are some combination of colors
- Covering one camera leads to a black image
- Covering another camera leads to a red-shaded image

One of the cameras must not be wired up correctly.
2020-05-18 00:11:09 -04:00
Brandon Thomas cfb4f8d6dd Handle multi-cam vertex array object buffer for color (doesn't work yet)
The code works to load multiple VAOs and buffers, but the camera data
isn't properly segregated yet. Need to figure out what to bind
2020-05-17 23:10:50 -04:00
Brandon Thomas ce64b80fed upgrade tch.rs 0.1.3 -> 0.1.7 (still segfaults) 2020-05-17 19:47:54 -04:00
Brandon Thomas ad0ca149f8 I *think* this works now. See binding=0,1 in GLSL
Note: we're currently looking at pointCloudTexture1, which is a
different depth camera from the color data
2020-05-17 05:55:58 -04:00
Brandon Thomas ed74711f80 switch between camera for point cloud renders 2020-05-17 04:10:29 -04:00
Brandon Thomas a882e89b1c show both converted depth xyz textures! 2020-05-17 03:59:25 -04:00
Brandon Thomas 83d7534b26 Visualizer now switches between multiple cameras (one at a time) 2020-05-17 03:37:34 -04:00
Brandon Thomas 99a9a2f966 Incremental support for multiple cameras: PointCloudVisualizer
Lots of internal use of Vec<T>, but still tied to 0-indexed items

 Code quality --

 Still compiles and runs
2020-05-17 03:06:42 -04:00
Brandon Thomas d09aab5743 Incremental support for multiple cameras: Multiple PointCloudConverter
Code quality --
Suport ++
2020-05-17 02:40:57 -04:00
Brandon Thomas 83cee2c4f2 make more readable by sending basenames to frontend 2020-05-15 03:00:49 -04:00
Brandon Thomas 9772cabd99 Model picker! Updated frontend and backend
This allows the frontend user to choose which melgan and tacotron are
used at runtime without restarting the server. It could use UI
improvement, but it works.

The available models are configured with a toml config file loaded by
the backend.
2020-05-15 01:20:52 -04:00
Brandon Thomas f5cf28a589 upgrade sentence.rs 2020-05-11 02:21:28 -04:00
Brandon Thomas b3432795e5 Better space insertion, handling of punctuation 2020-05-11 00:30:10 -04:00
Brandon Thomas 6139bc6b3d Add sentence/numerics.rs for tokenization, numbers 2020-05-10 22:55:15 -04:00
Brandon Thomas 7b2eff1387 uncommitted changes to frontend 2020-05-10 22:42:07 -04:00
Brandon Thomas 8625daa59d Add frontend index.html 2020-05-10 22:39:00 -04:00
Brandon Thomas d2f517b092 doc commit 2020-05-06 20:58:38 -04:00
Brandon Thomas 33bf87a1e4 uncommitted changes 2020-05-06 20:58:05 -04:00
Brandon Thomas d18efaaefc make enabling webcam easier 2020-05-05 05:15:12 -04:00
Brandon Thomas 83954a0742 update so we don't have to specify secondary devices 2020-05-05 05:12:31 -04:00
Brandon Thomas c83bf467c0 synchronized capture! (still only reading one image) 2020-05-04 05:38:41 -04:00
Brandon Thomas 5bb60032c3 multi-device capturer (starts multiple cameras in order) 2020-05-04 04:44:38 -04:00
Brandon Thomas 9081a3da26 refactor: organize kinect and opengl modules 2020-05-04 03:28:41 -04:00
Brandon Thomas a4d16224c2 refactor (move arcball to gui code) 2020-05-04 02:10:56 -04:00
Brandon Thomas 2a0cb25a8f no more SDL arcball for now 2020-05-04 02:07:02 -04:00
Brandon Thomas a06afdde38 handle zoom only within imgui window 2020-05-04 02:05:11 -04:00
Brandon Thomas c2c9dbceed animation hacks 2020-05-03 22:22:33 -04:00
Brandon Thomas 52338b9bcb animation 2020-05-01 07:25:05 -04:00
Brandon Thomas 95fec69018 stupid experimentally determined camera zero :( 2020-05-01 07:13:37 -04:00
Brandon Thomas 67a10b0892 custom perspective matrix based on k4a 2020-05-01 06:07:32 -04:00
Brandon Thomas 991f1b8aaa clear color, rgbaf32 type 2020-05-01 05:16:33 -04:00
Brandon Thomas ba5366d65e clean up some unused imports 2020-05-01 04:53:29 -04:00
Brandon Thomas 65f1d5b980 ran cargo fix and then CLion import optimizer 2020-05-01 04:40:21 -04:00
Brandon Thomas 21d40a9fe9 about to run cargo fix 2020-05-01 04:28:54 -04:00
Brandon Thomas 790e0a9748 move old code (preserved since I'm still new to this) 2020-05-01 04:25:40 -04:00
Brandon Thomas 0ffa97f9af new arcball abstraction to clean up code 2020-05-01 04:21:45 -04:00
Brandon Thomas 22a48dba60 arcball implementation (a bit rough around the edges) 2020-05-01 03:07:45 -04:00
Brandon Thomas e2671e4380 much more efficient and cleaned up WebcamWriter 2020-04-30 21:40:10 -04:00
Brandon Thomas e29d003973 akvcam config pared down to sensible configs 2020-04-30 05:07:53 -04:00
Brandon Thomas 2c6e205ac5 check in akvcam configs 2020-04-30 04:53:19 -04:00
Brandon Thomas 0ae6682518 THIS WORKS. WEBCAM OUT WORKS 2020-04-30 03:14:54 -04:00
Brandon Thomas 1721d1b3da width and height GRADIENT rendering are perfect 2020-04-30 03:07:26 -04:00
Brandon Thomas b581e9cd36 lets me share a webcam view, but horrible and distorts texture 2020-04-29 23:34:43 -04:00
Brandon Thomas 02eb6ec94a this has output, but it's hidden. only the very top shows 2020-04-29 05:20:15 -04:00
Brandon Thomas 38d3258a44 I can stream to the virtual device /dev/video7! 2020-04-29 03:28:02 -04:00
Brandon Thomas 50255bef04 small refactor, different clearcolor 2020-04-28 03:19:02 -04:00
Brandon Thomas cc1f822f5c add distance threshold and scaling 2020-04-28 03:08:25 -04:00
Brandon Thomas 6685e41e14 IT WORKS !! ! ! ! ! ! !! !!@!21 2020-04-27 05:10:56 -04:00
Brandon Thomas 299390f9b4 restored shaders 2020-04-27 04:47:26 -04:00
Brandon Thomas 4f8279bc9e cleanup (note - I pared down the existing shader, so I should revert) 2020-04-27 04:40:48 -04:00
Brandon Thomas 4f3e5f0e5c implementation of simple/color shading (perfect!) 2020-04-26 21:28:16 -04:00
Brandon Thomas c591d0d6c1 FIXED! Ugh. RG32F, not RGB32F 2020-04-26 19:27:25 -04:00
Brandon Thomas 27c5f32e80 debugging xy depth table 2020-04-26 18:47:59 -04:00
Brandon Thomas 87fbf45ed9 cleanup 2020-04-26 17:29:40 -04:00
Brandon Thomas 73ef98251e much closer, but still have to finish the last piece 2020-04-26 05:34:28 -04:00
Brandon Thomas 0bbbe2f9c2 point cloud colorization isn't it... 2020-04-26 04:14:45 -04:00
Brandon Thomas 2225c1c962 removing alpha from compute shader -- now the texture exists!!! 2020-04-26 04:10:49 -04:00
Brandon Thomas 242aa53b7d now we can set xyz texture to all white in the shader 2020-04-26 04:07:25 -04:00
Brandon Thomas ba56591226 fix issue with pixel iteration order 2020-04-26 01:19:07 -04:00
Brandon Thomas 2ee94842af handle debug bgra32 images 2020-04-26 00:52:06 -04:00
Brandon Thomas db4585fa5c pixel image debugging 2020-04-26 00:46:22 -04:00
Brandon Thomas 504e28240a need to impl depth pixel colorizer 2020-04-26 00:20:25 -04:00
Brandon Thomas ab2f4c33ae new image debug routine 2020-04-25 23:59:42 -04:00
Brandon Thomas 553afd801d display output in quadrants 2020-04-25 18:01:40 -04:00
Brandon Thomas 4aee7995c5 nice cleanup to surface all intermediate textures 2020-04-25 17:46:22 -04:00
Brandon Thomas a9e1af8c7f light refactor - rename classes 2020-04-25 17:31:07 -04:00
Brandon Thomas 54063f2553 improve xy_table generation (still not fixed)
The visual output is a vertical line with camera input colorization
2020-04-25 17:19:49 -04:00
Brandon Thomas 966bb66b53 a line of color with the correct matrix! 2020-04-24 03:32:51 -04:00
Brandon Thomas 5b11bca593 projection and view matrices (no effect?!) 2020-04-22 04:42:00 -04:00
Brandon Thomas eadafd34ab That pixel is real geometry. About to mess w/ projection matrix 2020-04-22 04:16:29 -04:00
Brandon Thomas 4dab692e2d THAT PIXEL IS NOW ANIMATED!?!#@? 2020-04-22 03:58:05 -04:00
Brandon Thomas ef2770a50b clean up comments 2020-04-22 03:40:29 -04:00
Brandon Thomas b0fab79970 small fixes, still no video 2020-04-22 03:19:28 -04:00
Brandon Thomas 7b450769bc resized window 2020-04-22 01:19:01 -04:00
Brandon Thomas d52d7d9b8e something is drawing on top of the texture! 2020-04-22 01:04:35 -04:00
Brandon Thomas 8e5f526c2c reorganize - opengl module, rebinder struct 2020-04-22 00:54:41 -04:00
Brandon Thomas 0de5a9bb38 render image *and* frame (but still not visible) 2020-04-22 00:24:55 -04:00
Brandon Thomas a1dc4e124c shows the texture in an opengl-backed imgui renderer! 2020-04-22 00:15:40 -04:00
Brandon Thomas 3998022aa0 load custom texture, but can't render it 2020-04-21 23:53:13 -04:00
Brandon Thomas bf2f1ee35f Everything reenabled, imgui still renders!! 2020-04-20 04:14:25 -04:00
Brandon Thomas 7436f088da with viz, this "supposedly" reverses everything (but doesn't) 2020-04-20 03:26:43 -04:00
Brandon Thomas 820715bd40 Holy shit, rebinding the texture worked on visualizer!
I was listening to some old Golden Sun music and it crscendoed
right as the demo worked.

https://www.youtube.com/watch?v=A6Z4QoUsd_8

After a week of no visuals, now I'm running some of this code with
visual output.
2020-04-20 03:00:48 -04:00
Brandon Thomas bfe2e16a40 BY BINDING THE OLD TEXTURE, WE RESTORE IMGUI 2020-04-20 02:57:38 -04:00
Brandon Thomas 730bf8b3ce extract opengl debugging 2020-04-20 02:35:00 -04:00
Brandon Thomas 2f56db8c06 had to load gl function ptrs (gl::load_with(...)) 2020-04-20 02:12:47 -04:00
Brandon Thomas 7618577e5e add imgui-rs (downgrade glium and glutin) 2020-04-20 01:59:51 -04:00
Brandon Thomas c1ff0273ee zero out memory 2020-04-20 01:08:29 -04:00
Brandon Thomas 0cd7c0c454 capture refcounts 2020-04-19 06:48:12 -04:00
Brandon Thomas c65d0c9b64 fix xy_table init 'valid' bit, lots of debug statements... 2020-04-19 06:02:49 -04:00
Brandon Thomas 2df1ba36cc better k4a image refcount handling, lots of logging, ... 2020-04-19 05:04:52 -04:00
Brandon Thomas 71e1de69ad no longer double freeing captures 2020-04-19 02:47:02 -04:00
Brandon Thomas e7acd39320 wasn't binding the shader program (still not fixed) 2020-04-19 01:18:06 -04:00
Brandon Thomas 0dbb9888d3 more debugging; added glDebug callback 2020-04-19 01:15:53 -04:00
Brandon Thomas ce30f437c2 introduced rng as point cloud output 2020-04-18 23:38:37 -04:00
Brandon Thomas 8a466882c4 wrong byte divisor 2020-04-18 23:25:18 -04:00
Brandon Thomas e62ff78730 this runs for awhile before crashing (still no point cloud) 2020-04-18 23:22:48 -04:00
Brandon Thomas e192369bb8 Runs. Old webcam input had to be removed. Still can't update texture 2020-04-18 22:57:34 -04:00
Brandon Thomas fae1d4001c no segfaults 2020-04-18 22:35:31 -04:00
Brandon Thomas 726e8ccc56 this runs (old code paths), commented out new stuff.
let's iterate from here...
2020-04-18 22:20:25 -04:00
Brandon Thomas 5f6237d03e This segfaults at runtime, but I think pieces are in place 2020-04-18 20:04:14 -04:00
Brandon Thomas a111e8653a viewer image 2020-04-18 18:54:05 -04:00
Brandon Thomas 2962a29b3f cleanup guard, update texture 2020-04-18 17:28:11 -04:00
Brandon Thomas 4dd75420d6 partially done with visualizer update_point_clouds 2020-04-18 17:11:07 -04:00
Brandon Thomas d3592431e7 set_colorization_strategy 2020-04-18 06:44:35 -04:00
Brandon Thomas 78da717595 visualizer, ctor, update_texture, wip/untested 2020-04-18 05:39:49 -04:00
Brandon Thomas 6aa57fb712 error handling 2020-04-18 01:45:10 -04:00
Brandon Thomas 4ba7827677 add error enum 2020-04-17 23:23:37 -04:00
Brandon Thomas 9b08c5b16f render() untested 2020-04-17 04:04:30 -04:00
Brandon Thomas 07ab055aca renderer - update_point_clouds function (untested) 2020-04-17 03:56:22 -04:00
Brandon Thomas 7512e06240 starting work on the rendering shader, everything compiles but untested 2020-04-17 02:44:12 -04:00
Brandon Thomas 72e326702a memory copy piece (don't know if it works) 2020-04-17 01:21:00 -04:00
Brandon Thomas 9c162d472a uniform binding 2020-04-17 00:38:33 -04:00
Brandon Thomas 2e6597048b 2d to 3d was impl'd in the library! 2020-04-17 00:17:37 -04:00
Brandon Thomas e94b9c44dd attempt at writing array of struct memory... (untested) 2020-04-16 05:40:43 -04:00
Brandon Thomas 7d19979b1d k4a image constructor 2020-04-16 05:08:20 -04:00
Brandon Thomas 1db741dc12 set_active_xy_table impl, not tested 2020-04-16 03:50:09 -04:00
Brandon Thomas d50f91fa19 convert 2020-04-16 03:40:33 -04:00
Brandon Thomas bacb2072ef sort these 2020-04-16 03:31:00 -04:00
Brandon Thomas 88c447d35a replace raw opengl with wrappers in a few places 2020-04-16 03:26:48 -04:00
Brandon Thomas 4a3bd917c6 opengl wrapper for convenience 2020-04-16 02:49:41 -04:00
Brandon Thomas 69820d00bd move unused graphics libs to module to remove later 2020-04-16 02:08:54 -04:00
Brandon Thomas 3a56e9e0e2 point cloud code builds, but isn't correct yet 2020-04-16 01:59:06 -04:00
Brandon Thomas 6c9740d86c working on point cloud shader (wip) 2020-04-15 04:06:43 -04:00
Brandon Thomas 2f6484bf82 create a compute shader from the k4a libs 2020-04-14 03:34:26 -04:00
Brandon Thomas 52fbe25154 streaming color camera 2020-04-13 05:09:08 -04:00
Brandon Thomas 65d397c5f1 now it's streaming! 2020-04-13 04:50:58 -04:00
Brandon Thomas ebb4bcaf3d texture was actually easy, it's just not redrawing without input 2020-04-13 04:44:45 -04:00
Brandon Thomas 5bd3f95bfa stringly typed binding. UGH. fixed 2020-04-13 04:27:08 -04:00
Brandon Thomas 5c57a0aaa1 wip (not working) 2020-04-13 00:06:39 -04:00
Brandon Thomas 2a6378a687 texture setup ... but is it working? 2020-04-12 23:31:28 -04:00
Brandon Thomas 93d2110419 square via ebo! 2020-04-12 23:02:48 -04:00
Brandon Thomas a56fe7b6b6 now drawing with element array buffers! 2020-04-12 22:59:33 -04:00
Brandon Thomas fdc395ae54 helper functions for stride and offset 2020-04-12 22:29:35 -04:00
Brandon Thomas 1f21bb17d6 got attribute pointers for stride! 2020-04-12 22:22:39 -04:00
Brandon Thomas 9470d037d7 color uniform 2020-04-12 22:10:12 -04:00
Brandon Thomas d7cc98b1ab try to line this up with open.gl tutorial 2020-04-12 22:04:18 -04:00
Brandon Thomas 3ec973d123 cleanup 2020-04-12 21:31:56 -04:00
Brandon Thomas 0a62edafec now trying a mix of gl, glium, glfw 2020-04-12 21:20:52 -04:00
Brandon Thomas 910b68617b unpack from captureprovider 2020-04-12 20:44:27 -04:00
Brandon Thomas 5905830343 I don't like 'unsafe impl Send' :( :( :( 2020-04-11 03:46:27 -04:00
Brandon Thomas 220763d47f move the handwritten k4a wrappers out of the way 2020-04-11 02:41:21 -04:00
Brandon Thomas fce6e0f86f swapped glium for grr (no longer streaming frames!) 2020-04-11 02:24:49 -04:00
Brandon Thomas e681eeff76 move glium stuff, going to try grr 2020-04-11 02:13:47 -04:00
Brandon Thomas 4fc0363a62 small refactor, comment 2020-04-11 01:41:37 -04:00
Brandon Thomas 0107483c82 minor cleanup 2020-04-06 01:54:31 -04:00
Brandon Thomas b807346714 offload processing onto acquisition thread (needs cleanup!) 2020-04-06 01:49:51 -04:00
Brandon Thomas 58c72b24c3 smaller critical section, but didn't fix lag 2020-04-05 22:46:19 -04:00
Brandon Thomas 3ce5d4d871 optimize imports 2020-04-05 22:24:29 -04:00
Brandon Thomas 5c6f5b019d streams image, but grossly suboptimal (<<1 FPS) 2020-04-05 22:21:38 -04:00
Brandon Thomas 22fc554ea1 cleanup 2020-04-05 21:52:19 -04:00
Brandon Thomas 3c59597309 I got a kinect frame into OpenGL! 2020-04-05 03:52:59 -04:00
Brandon Thomas ae4dd1f536 image loads, but is probably wrong byte depth 2020-04-05 03:48:33 -04:00
Brandon Thomas 783b92aaed compiles, but fails at runtime for wrong image format 2020-04-05 03:27:55 -04:00
Brandon Thomas 8364d000f5 Switch textures in OpenGL/Glium 2020-04-05 02:36:42 -04:00
Brandon Thomas 1ed32ff356 display depth image 2020-04-04 04:19:37 -04:00
Brandon Thomas ed811d031c read images from the sensor 2020-04-04 04:14:32 -04:00
Brandon Thomas 19dbab3a05 obtain capture 2020-04-04 03:48:44 -04:00
Brandon Thomas 40aa93c46b Now we can start and stop the cameras 2020-04-04 03:33:42 -04:00
Brandon Thomas f859b9dd74 start writing wrappers for k4a-sys 2020-04-03 23:16:09 -04:00
Brandon Thomas 04f3c36201 Lo! A new library appears on the horizon: k4a-sys 2020-04-03 00:51:21 -04:00
Brandon Thomas f1351dbf49 and even the segfaults went away 2020-03-28 05:47:42 -04:00
Brandon Thomas 99bc74cb73 Over time, the pointers started to look right 2020-03-28 05:34:38 -04:00
Brandon Thomas 0f37d06b99 Properly "000513594512" without a NUL terminal. 2020-03-28 04:45:52 -04:00
Brandon Thomas bb6a0e6692 And that's how we discovered 000513594512 (extra byte) 2020-03-28 04:40:44 -04:00
Brandon Thomas 2ed9758cbb And it told us serial size: 13. 2020-03-28 04:34:55 -04:00
Brandon Thomas babcdb10d3 The answer was correct pointer use! 2020-03-28 04:07:05 -04:00
Brandon Thomas 4a24ea8b11 but it was hard to read from and close them. 2020-03-28 03:59:02 -04:00
Brandon Thomas 63e850e824 and we found we could open devices
(But not close them)
2020-03-28 03:13:13 -04:00
Brandon Thomas 96615927cd At first we could call libk4a
(And this actually does work! I tried!)

```
hello world
Device count: 1
```
2020-03-28 02:32:13 -04:00
Brandon Thomas cf8580dce9 Once upon a time 2020-03-28 01:51:32 -04:00
Brandon Thomas f7b6c3582f deploying new trumped arpabet engine to DigitalOcean k8s 2020-02-06 12:24:41 -05:00
Brandon Thomas 6e766720ca UI improvements 2020-01-19 02:54:55 -05:00
Brandon Thomas b1777f74ce better style 2020-01-19 02:31:43 -05:00
Brandon Thomas 42bded9656 better frontend with history (messy, though) 2020-01-18 02:59:27 -05:00
Brandon Thomas 96a146c5e1 Arpabet processing in Tacotron 2020-01-16 03:17:50 -05:00
Brandon Thomas 9570339569 fix asset frontend and directory 2020-01-11 01:00:39 -05:00
Brandon Thomas 6b5c225676 Frontend works; added static serving to server 2020-01-10 11:42:19 -05:00
Brandon Thomas 47f12cbb94 Frontend now plays audio 2020-01-10 02:34:50 -05:00
Brandon Thomas cad84328c4 Frontend skeleton that can post to backend 2020-01-09 03:48:07 -05:00
Brandon Thomas 8ac98c973a npx create-react-app tts_frontend
--template=typescript

This is just the boilerplate
2020-01-08 18:56:56 -05:00
Brandon Thomas 841c644d57 Dockerfile for release build 2020-01-07 01:21:54 -05:00
Brandon Thomas d25f9a6a17 Shared S3 (digitalocean space) volume 2020-01-07 01:18:41 -05:00
Brandon Thomas ea761a76b9 improved deployment w liveness + readiness probes 2020-01-06 19:33:12 -05:00
Brandon Thomas 374e1a477d Server with Torch + Libtorch; Model load via env 2020-01-06 18:18:39 -05:00
Brandon Thomas da29a1f403 This deployment works, finally 2020-01-06 04:48:07 -05:00
Brandon Thomas a8858f2375 argument for address binding 2020-01-06 04:24:53 -05:00
Brandon Thomas 539570e079 k8s deployment, change network interface binding 2020-01-06 03:06:05 -05:00
Brandon Thomas d5f4d229ff move workflow (why didn't wysiwyg create here?) 2020-01-06 00:44:30 -05:00
Brandon Thomas 601fcb525d YAML config for github action to publish to GPR 2020-01-06 00:43:19 -05:00
Brandon Thomas de4cf5c174 Docker container. Breaks tacotron_melgan (haven't ported to actix) 2020-01-06 00:18:33 -05:00
Brandon Thomas 9f73582091 Adding skeleton of deployable service 2020-01-05 05:47:09 -05:00
Brandon Thomas 6fdbaa2ad1 this works 2020-01-05 03:29:17 -05:00
Brandon Thomas 91dea21a2f This works!! 2020-01-04 05:15:30 -05:00
Brandon Thomas 914631c72c It works! Wrong output sample rate - 20000 2020-01-04 05:11:51 -05:00
Brandon Thomas edd521f2fd exact audio tensor match with python tacotron-melgan (wav audio still off) 2020-01-04 05:02:17 -05:00
Brandon Thomas 9baea196d8 (not working, wip) 2020-01-04 04:33:47 -05:00
Brandon Thomas 25de25e3b0 Everything necessary to do scripting instead of tracing 2020-01-03 02:47:34 -05:00
Brandon Thomas ad694e77a4 Change JIT mel tensor to float (from double). Works. 2020-01-03 02:35:44 -05:00
Brandon Thomas ee5e48eae5 wip loading mels 2020-01-03 00:59:21 -05:00
Brandon Thomas 89e414225f Fixes to get this working with JIT scripting (vs tracing) 2020-01-02 04:45:09 -05:00
Brandon Thomas 1ca7ee8a5b rename models 2020-01-02 01:19:49 -05:00
Brandon Thomas c0cac635f4 Add README to tacotron_melgan 2019-12-31 04:33:53 -05:00
Brandon Thomas 465a6f87f2 unsqueeze - still not working 2019-12-30 06:34:19 -05:00
Brandon Thomas 1f9235d56e added text input, but it fails currently 2019-12-30 06:27:35 -05:00
Brandon Thomas 56e553ae66 Serving over Rocket HTTP works (very inelegant ATM) 2019-12-30 05:59:27 -05:00
Brandon Thomas 6c4d97e860 minor cleanup 2019-12-30 04:45:10 -05:00
Brandon Thomas f51a7cd621 This works end-to-end 2019-12-30 04:15:34 -05:00
Brandon Thomas 89d08a449e Rust Tacotron2 model runs, albeit SLOWLY 2019-12-30 03:48:24 -05:00
Brandon Thomas 4079ec379c Tacotron model JIT works? 2019-12-30 03:41:57 -05:00
Brandon Thomas 3aacd5412e add sequence file 2019-12-30 03:13:28 -05:00
Brandon Thomas c986184fbf This may have done it! (Python 3.6 upgrade helped) 2019-12-30 01:32:01 -05:00
Brandon Thomas 6985075187 This compiles but is garbage
- I removed Tacotron2.forward
2019-12-29 02:50:19 -05:00
Brandon Thomas c86eeea550 minor progress, Tacotron JIT still does not work 2019-12-27 03:13:47 -05:00
Brandon Thomas 03cd0dc0db model jit wrapping: got rid of postnet (wip) 2019-12-27 03:04:49 -05:00
Brandon Thomas e492e2e10c Added hparams and chopped off a few model pieces. Doesn't work yet 2019-12-27 02:46:05 -05:00
Brandon Thomas 2c33358db7 add nvidia's tacotron2 model 2019-12-27 02:31:30 -05:00
Brandon Thomas 546e5d7a09 Adding Tacotron2 wrapper (WIP) 2019-12-27 02:29:09 -05:00
Brandon Thomas 6982e65e0c rename script 2019-12-27 00:24:18 -05:00
Brandon Thomas c2b03c461a seems pretty fast 2019-12-26 06:49:03 -05:00
Brandon Thomas f051ab76a0 Now there's human voice audio!!!! WOO! 2019-12-26 06:44:40 -05:00
Brandon Thomas 57cbe02d7d rename the model nodes 2019-12-26 06:33:42 -05:00
Brandon Thomas 60763c5120 I think this fixes the ResBlock 2019-12-26 06:01:00 -05:00
Brandon Thomas 3de3a3770c add random sampling 2019-12-26 05:10:08 -05:00
Brandon Thomas f07a628469 this makes clicking noises, but still mostly zero 2019-12-26 05:02:57 -05:00
Brandon Thomas 55947770cd Model outputs audio, but all zeroes right now 2019-12-26 03:39:16 -05:00
Brandon Thomas 346855955c Useful hacky script for jit containerizing mels/tensors
This seems to be the only(?) way of loading single tensors into
libtorch/tch.rs. It's a hack: load the tensor, pack it into a container
module, then define a forward method that returns the wrapped tensor.
2019-12-26 02:02:25 -05:00
Brandon Thomas b9efb9db60 This might be a new approach... 2019-12-26 01:21:41 -05:00
Brandon Thomas 99d13ed283 light refactor 2019-12-25 17:01:28 -05:00
Brandon Thomas 615595c0d3 Add some mels for testing 2019-12-25 16:49:01 -05:00
Brandon Thomas 194c220ad2 Move melgan scripts to sub-project 2019-12-25 16:32:43 -05:00
Brandon Thomas 282e05340f Now the two Tacotron projects work with the Rust Workspace 2019-12-25 01:54:02 -05:00
Brandon Thomas a03966c209 Refactor into "workspace" project. VC sidecar works again!
Tensorflow Tacotron and Torch Tacotron+Melgan are broken (the latter
hasn't worked yet anyhow)
2019-12-25 01:31:19 -05:00
Brandon Thomas 56ba5fbaaa wip (I need to restructure this entire codebase) 2019-12-25 00:05:57 -05:00
Brandon Thomas da9ffb03bf closer match py JIT output; can load/eval from rust 2019-12-23 16:40:45 -05:00
Brandon Thomas 5d0d22c5f8 Adds the ability to load PyTorch models (read more)
- Python script de-cudas the models and exports them in the
understandable "zip" format. (The models output by MelGan, Tacotron, etc
do not conform to something Rust's libtorch bindings can understand by
default)

- Adds the Rust code to load but not the cargo deps since that needs a
refactor. The version is `tch = "0.1.3"`
2019-12-23 15:01:39 -05:00
Brandon Thomas b77de37029 Merge branch 'master' of github.com:echelon/voder 2019-12-16 01:33:15 -05:00
Brandon Thomas 01896b7f9a crop image, add lots of comments 2019-12-14 04:06:45 -05:00
Brandon Thomas 3bf8f3a044 this looks much closer to a spectrogram 2019-12-14 03:28:08 -05:00
Brandon Thomas 4408fd664e image visualization (WIP) 2019-12-14 03:24:23 -05:00
Brandon Thomas ed1f63c9a3 Pow_1 looks like a good point - very fast on CPU 2019-12-14 02:43:10 -05:00
Brandon Thomas d1d3957310 Merge branch 'master' of github.com:echelon/voder 2019-12-13 03:47:06 -05:00
Brandon Thomas 26cb3bdaaf (temporary GPU build break) 2019-12-13 03:46:46 -05:00
Brandon Thomas 5431902f8d Merge branch 'master' of github.com:echelon/voder 2019-12-13 03:45:09 -05:00
Brandon Thomas 011690ce8b (temporary GPU build break) 2019-12-13 03:44:54 -05:00
Brandon Thomas e5f50002da (temporary GPU build break) 2019-12-13 03:35:50 -05:00
Brandon Thomas 1958622d8c generalize function 2019-12-11 04:24:22 -05:00
Brandon Thomas 95561e2568 signal reconstituted, but a bit loud 2019-12-11 04:14:48 -05:00
Brandon Thomas 774789c607 comment 2019-12-11 03:11:01 -05:00
Brandon Thomas 06d0bbcbba spacing cleaup (minor), added cleaned sentence 2019-12-11 03:08:30 -05:00
Brandon Thomas 9dd998714a This runs! 2019-12-11 02:52:47 -05:00
Brandon Thomas 15570be82d Inputs and tensors appear to be correct - now need to get data/dims 2019-12-11 02:42:33 -05:00
Brandon Thomas dd9362352e Add 2nd binary to load tacotron (Keith Ito) model 2019-12-11 01:16:29 -05:00
Brandon Thomas dee59f5f4c Add 2nd binary for tacotron 2019-12-10 23:59:50 -05:00
Brandon Thomas 32a54e395d record before (or right during) activating edge.
This keeps the beginning audio segment from being choppy.
2019-11-08 03:24:15 -05:00
Brandon Thomas 354c6a7261 Move sidecar out to own module 2019-11-08 02:29:12 -05:00
Brandon Thomas 37d8c9ec85 Move CPAL mic/speaker into new module 2019-11-08 01:56:57 -05:00
Brandon Thomas 16639c7bed README multi-gpu, CycleGAN sample rate cleanup 2019-11-08 01:23:30 -05:00
Brandon Thomas 7f325513fb This is almost realtime and should work in conversation 2019-10-21 04:11:03 -04:00
Brandon Thomas 89d3ae6362 heuristic for pausing the mic 2019-10-21 04:08:09 -04:00
Brandon Thomas ed05ab1551 well, this is as best as the model does so far... 2019-10-21 03:37:08 -04:00
Brandon Thomas fe5e15f206 This sounds good coming back down the pipe... 2019-10-21 03:23:01 -04:00
Brandon Thomas 21bc256478 This might be right up until sending back. Might just need an upsample!
Original audio - sounds good
Downsampled audio - sounds good
Model output - sounds good (might even be closer to trump, didn't test
enough)

Voder audio - squeaky. needs upsample probably
2019-10-21 03:18:02 -04:00
Brandon Thomas 4155fa4e36 this is a good shape for debugging 2019-10-21 03:12:26 -04:00
Brandon Thomas f096ae07bf Changing proto schema. Degradation in quality.
I had something really close. That might not have found it into a
commit between now and the last commit :(
2019-10-21 02:58:05 -04:00
Brandon Thomas af20a57e8a THIS EVALUATES THE MODEL IN REALTIME +3-6sec delay
Still doesn't sound right. Probably a sample rate issue.
2019-10-20 03:10:21 -04:00
Brandon Thomas d63007ac9f Experimenting - trying to figure out why audio sounds so bad 2019-10-20 02:50:18 -04:00
Brandon Thomas 7e33d9c7ca Add my demo_server.py implementation from CycleGAN 2019-10-20 02:18:51 -04:00
Brandon Thomas b38c96ae2f Protobufs UP and DOWN. Sounds great! 2019-10-20 02:04:41 -04:00
Brandon Thomas 05b703068a THIS SOUNDS FANTASTIC (no transform yet, 1:1 audio) 2019-10-20 01:51:55 -04:00
Brandon Thomas 6df1e8b072 Two way works over protobuf! Woo! This will be so much better... 2019-10-20 01:36:12 -04:00
Brandon Thomas dc9983e45b Protos in python 2019-10-20 01:17:25 -04:00
Brandon Thomas 45a8dc446e Better proto pipeline 2019-10-20 00:48:18 -04:00
Brandon Thomas 1ae8aafd5a Add protos. Temporarily commented out TensorFlow pieces 2019-10-20 00:38:04 -04:00
Brandon Thomas 47022cdeeb Copy relevant CycleGAN code here.
master @ 1ca8b078c12d915bca1f57e822859fa20bd439c8
Date:   Tue Oct 15 10:50:12 2019 -0400
2019-10-20 00:11:53 -04:00
Brandon Thomas 7c3f3255b0 STUPID VEC POP WAS THE ISSUE 2019-10-15 02:59:16 -04:00
Brandon Thomas 4b956e594f get rid of unneeded loop 2019-10-15 02:45:18 -04:00
Brandon Thomas 86900188d8 super direct round trip 2019-10-15 01:49:38 -04:00
Brandon Thomas 708a728b85 simple audio roundtrip 2019-10-15 01:41:24 -04:00
Brandon Thomas de07378bcb cleanup! 2019-10-15 01:20:37 -04:00
Brandon Thomas 7916f7c307 this inquires about processed buffer length 2019-10-15 00:55:12 -04:00
Brandon Thomas a6ac91331e whellp, there's the data round trip. This is bad 2019-10-15 00:35:34 -04:00
Brandon Thomas ff0a7d7922 sending successfully 2019-10-14 20:00:21 -04:00
Brandon Thomas 6464e6344d fix formatting 2019-10-14 19:18:21 -04:00
Brandon Thomas 9f11012252 add CPAL 2019-10-14 19:14:47 -04:00
Brandon Thomas 8f611958a3 sending more data is better 2019-10-13 22:20:10 -04:00
Brandon Thomas 6d928fa7ec cleanup speaker/mic 2019-10-13 21:49:23 -04:00
Brandon Thomas 64e4018640 This works with large byte buffers! Sidecar reconstitutes the audio 2019-10-13 21:42:32 -04:00
Brandon Thomas 592bebe823 drained send 2019-10-13 21:35:43 -04:00
Brandon Thomas 089aab7930 move model stuff to new file 2019-10-13 21:23:11 -04:00
Brandon Thomas 58cfbef65e sending audio, but still very broken 2019-10-13 20:51:18 -04:00
Brandon Thomas e88cc5ff24 ZeroMQ IPC (first steps) 2019-10-13 00:41:46 -04:00
Brandon Thomas 08d7fc6797 zeromq 2019-10-12 23:21:37 -04:00
Brandon Thomas 41e9e45fe7 start work on synthesis 2019-10-11 01:58:39 -04:00
Brandon Thomas af2f5ba68e Modify readme 2019-10-11 00:21:54 -04:00
Brandon Thomas cd6b5a37fd change how dep override is declared 2019-09-30 01:43:44 -04:00
Brandon Thomas a66a084a84 same dimensions for input! 2019-09-23 20:02:00 -04:00
Brandon Thomas 3cd90ded8b more OO 2019-09-23 01:42:25 -04:00
Brandon Thomas 5cc533061e This returns a tensor... 2019-09-23 01:25:47 -04:00
Brandon Thomas 2377494231 Getting closer... 2019-09-23 01:23:30 -04:00
Brandon Thomas b9bb56085e this works with the model 2019-09-23 01:18:55 -04:00
Brandon Thomas 2364f770f2 Now dimensional issues:
>>> Tensor dims: [2, 2, 2]
2019-09-23 01:13:51.546620: W
tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at
conv_ops_fused_impl.h:692 : Invalid argument: input depth must be evenly
divisible by filter depth: 2 vs 24
2019-09-23 01:13:51.546627: W
tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at
conv_ops_fused_impl.h:692 : Invalid argument: input depth must be evenly
divisible by filter depth: 2 vs 24
thread 'main' panicked at 'Run success: {inner:0x5581658b56d0,
InvalidArgument: input depth must be evenly divisible by filter depth: 2
vs 24
         [[{{node generator_A2B_3/h1_conv_gates/conv1d}}]]}',
         src/libcore/result.rs:999:5
2019-09-23 01:14:34 -04:00
Brandon Thomas 2dd5894283 Found the names of the input and output tensors, now fixing args
Current runtime err:

```
2019-09-23 01:00:01.189765: W
tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at
transpose_op.cc:157 : Invalid argument: transpose expects a vector of
size 1. But input(1) is a vector of size 3
thread 'main' panicked at 'Run success: {inner:0x5589ea8b3860,
InvalidArgument: transpose expects a vector of size 1. But input(1) is a
vector of size 3
```

Getting there...!
2019-09-23 01:05:31 -04:00
Brandon Thomas 51b7fce129 Found the names of the input and output tensors, now fixing args
Current runtime err:

```
2019-09-23 01:00:01.189765: W
tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at
transpose_op.cc:157 : Invalid argument: transpose expects a vector of
size 1. But input(1) is a vector of size 3
thread 'main' panicked at 'Run success: {inner:0x5589ea8b3860,
InvalidArgument: transpose expects a vector of size 1. But input(1) is a
vector of size 3
```

Getting there...!
2019-09-23 01:00:55 -04:00
Brandon Thomas 3c715d9ef8 Merge branch 'master' of github.com:echelon/voder 2019-09-22 22:16:40 -04:00
Brandon Thomas 1201fc120a this is a valid argument (used incorrectly) 2019-09-17 18:47:26 -04:00
Brandon Thomas 9f3f4f7d60 model loads! 2019-09-17 01:50:47 -04:00
Brandon Thomas 4f331f3f83 model loading works, but is from a wrong version of tensorflow 2019-09-16 11:18:16 -04:00
Brandon Thomas 2982a82999 feedback, adding tensorflow 2019-09-16 03:26:18 -04:00
Brandon Thomas 0483c2fe6e comments and readme 2019-09-13 04:17:29 -04:00
Brandon Thomas 12440fe1fe add old "main.rs" as "weird.rs", add debugging to beep 2019-09-13 02:14:15 -04:00
Brandon Thomas 9482fb2302 add wavy example code 2019-09-13 01:50:00 -04:00
Brandon Thomas 39bdce3380 Add more examples from cpal 2019-09-13 01:47:54 -04:00
Brandon Thomas 8479a64a6b fixes in notes 2019-09-11 03:10:05 -04:00
Brandon Thomas fc043c96a6 add cpal example 2019-09-11 02:40:40 -04:00
Brandon Thomas 5bb16790d3 sin wave 2019-09-11 01:48:51 -04:00
Brandon Thomas 71c0edf0e8 much better fidelity 2019-09-11 01:16:24 -04:00
Brandon Thomas 73afdc7a98 add threshold for noise 2019-09-11 01:13:24 -04:00
Brandon Thomas 737103239c Update readme with instructions to change speaker 2019-09-11 00:53:11 -04:00
Brandon Thomas cbb9be2074 wip 2019-09-06 03:21:03 -04:00
Brandon Thomas 1146bb057d wow this sounds weird 2019-09-06 02:42:07 -04:00
Brandon Thomas ad98211cb9 starting experiments 2019-09-06 01:22:57 -04:00
Brandon Thomas c5a8db7537 Frontend copied into brandon.audio 2019-01-30 03:20:59 -05:00
Brandon Thomas 88c3fe71ad Configs for DNS, add brandon.audio deploy script 2019-01-30 03:06:11 -05:00
Brandon Thomas fd87bc4fbc rename scripts for easier discoverability 2019-01-30 01:56:59 -05:00
Brandon Thomas 57eeb6926c Rename script 2019-01-30 01:55:43 -05:00
Brandon Thomas a0b68fbdd0 Update meta information and title 2019-01-30 01:54:24 -05:00
Brandon Thomas c34b6358dc README with old jungle.horse configs 2019-01-30 01:50:35 -05:00
Brandon Thomas b09117bb87 todo 2019-01-30 00:55:49 -05:00
Brandon Thomas 758097445e Update TODO 2018-09-17 02:06:21 -04:00
Brandon Thomas a153a6e276 Where EBS container is hosted 2018-09-07 04:53:58 -04:00
Brandon Thomas 64d1e0eff3 Change HTML title 2018-09-07 04:32:01 -04:00
Brandon Thomas 3a66d5ac2e Update for 'trumped.com' 2018-08-28 03:54:34 -04:00
Brandon Thomas 3d32bd2fbc Trim down the index html of fluff 2018-06-12 04:52:32 -04:00
Brandon Thomas 473ea31f4d Rebuild arpabet override / changes file from diff 2018-06-12 04:04:10 -04:00
Brandon Thomas 5521c47ebc move legacy use of 'try!' to '?' 2018-06-11 02:34:42 -04:00
Brandon Thomas b68009408c Update to utilize arpabet.rs 2018-06-11 02:24:39 -04:00
Brandon Thomas 5f9d50c154 First update to build deps after years 2018-06-10 18:02:49 -04:00
Brandon Thomas 42533a9d0e Fix CDN host cdn.{junglehorse.com -> jungle.horse}
I'm letting junglehorse.com expire.
2017-01-14 02:17:09 -05:00
Brandon Thomas cf5288e913 add bigly 2016-11-08 16:14:13 -05:00
Brandon Thomas 71d10d2cf2 A few words 2016-11-08 04:39:35 -05:00
Brandon Thomas ab6924878a Add Google Analytics tracker 2016-11-08 01:46:12 -05:00
Brandon Thomas d0c9c98031 misc fixes 2016-11-07 03:29:39 -05:00
Brandon Thomas 94e8ba93cb enable caching in prod 2016-11-07 01:29:30 -05:00
Brandon Thomas bbea7ad9ff fixes 2016-11-07 01:28:11 -05:00
Brandon Thomas b5ee9a8980 Limit number of words or characters in the request
Config options for both.
2016-11-07 01:18:53 -05:00
Brandon Thomas 00db0b5854 server param for logging raw sentence 2016-11-07 00:50:42 -05:00
Brandon Thomas 28036a3702 add more words to custom dictionaries 2016-11-07 00:43:35 -05:00
Brandon Thomas da5ba07365 upload script for new jungle.horse S3 bucket (oops) 2016-11-07 00:13:54 -05:00
Brandon Thomas 4c44cd498a Update frontend, deploy script to use "static" image asset URLs 2016-11-06 23:53:36 -05:00
Brandon Thomas a7c880caf9 Remove old HTML pages and demo HTML handler 2016-11-06 22:58:12 -05:00
Brandon Thomas a04174cfda Deploy backend to AWS Elastic Beanstalk (EBS)
- Docker configs for AWS EBS

- Script to build artifact containing the Rust binary, configs, wav
  files, and Docker configs.

- Add documentation.
2016-11-06 22:16:58 -05:00
Brandon Thomas 2d92776c3a favicon, debug 2016-11-06 06:21:47 -05:00
Brandon Thomas a393a76920 add CDN host (perhaps not necessary?) 2016-11-06 05:55:06 -05:00
Brandon Thomas ccfbefddd1 Inject API host into the javascript (hack again) 2016-11-06 05:16:59 -05:00
Brandon Thomas 5c6cd281c4 fix cdn paths, add static error page 2016-11-06 05:05:22 -05:00
Brandon Thomas 6841ac7783 Fix paths in s3 upload by path substitution hack
Such a hacky thing to do...
2016-11-06 04:22:39 -05:00
Brandon Thomas 76791e5e0e adding bucket configs (no credentials / secrets) 2016-11-06 02:18:42 -05:00
Brandon Thomas 0ac50320e1 Add S3 deploy script 2016-11-06 01:35:58 -05:00
Brandon Thomas ac74a5fede Redesign DOM, add modal
- added an about modal
- donation links
2016-11-05 22:00:13 -04:00
Brandon Thomas bb751edc0a turn on syllables by default 2016-11-04 02:51:57 -04:00
Brandon Thomas d9c315fc28 animation, part 2
- minify flag for webpack
- add second animation
- fix existing animation (transition between stop and idle)
- abstraction of animation code into new class
2016-11-04 02:41:04 -04:00
Brandon Thomas b358895089 Sample prefs on syllables
- Fix bug(s) preventing syllable system from working
- Add logging
- Add many syllable heuristics.
2016-11-03 02:58:09 -04:00
Brandon Thomas 9ba0eeb090 bump server version 2016-11-02 03:29:25 -04:00
Brandon Thomas eeb213bb76 Better syllable synthesis
- Polysyllable fulfillment algorithm
  - w/ debug padding
  - Still needs "ends" support

- Lots of cleanup and improvement to syllable code
  - Added Polysyllable and Polysyllabic trait
  - Updated syllable heuristics for 3-syllable stretches
  - 4-syllable parsing
  - syllable debug logging + config
2016-11-02 03:26:09 -04:00
Brandon Thomas b011ce4b87 First implementation of "use syllables". 2016-11-01 03:34:29 -04:00
Brandon Thomas c232ec9534 more needed words 2016-11-01 02:49:08 -04:00
Brandon Thomas def50e48d5 basic loadtest script (actually, this sucks) 2016-10-30 06:27:38 -04:00
Brandon Thomas cdd9d4bac4 typescript build fixes 2016-10-30 05:34:10 -04:00
Brandon Thomas 32248e9e36 Fix UI "clear" button to clear URL state 2016-10-30 03:04:57 -04:00
Brandon Thomas 0ea02db27f Refactor of synthesis-related code
- refactor and modularize code into "sentence synth" and "word synth"
- change synth params in code and UI
- change error types, better error handling
2016-10-30 02:25:52 -04:00
Brandon Thomas 3344acf6db move parser dep from synthesizer to handler 2016-10-28 01:05:10 -04:00
Brandon Thomas 20f2f7a2ad cleanup, move effects mod into synthesis::effects 2016-10-28 00:47:51 -04:00
Brandon Thomas 43a731b05e request hashing move to request struct, tests++ 2016-10-28 00:29:01 -04:00
Brandon Thomas 22d77a7c95 Remove old "diphones" param, add (unused) syllables param 2016-10-28 00:01:57 -04:00
Brandon Thomas 63d6b3257f Cleanup audio synth handler
So much bad early code.
2016-10-27 23:48:14 -04:00
Brandon Thomas 90a0e367fa Syllable-based synthesis (WIP)
- Vowels indicate syllable

- Algorithm tracks consonants and uses heuristics to attach them to a
  vowel island.

- Still work in progress.
2016-10-27 01:27:55 -04:00
Brandon Thomas fd4bfbe920 Change logo 2016-10-25 21:33:27 -04:00
Brandon Thomas c6389a50bc don't animate on 500 2016-10-25 05:05:21 -04:00
Brandon Thomas 1b4e220b52 Cleanup, error handling 2016-10-25 05:02:26 -04:00
Brandon Thomas c983e88a0b bump to ver 0.11.0, add more abbreviations 2016-10-25 04:15:18 -04:00
Brandon Thomas cc71a9d8b6 Date parsing 2016-10-25 03:53:36 -04:00
Brandon Thomas db9e412495 Synthesize currency values, eg. "$10 million" 2016-10-25 00:47:16 -04:00
Brandon Thomas 0bebea4a0e Typescript + Vuejs 2016-10-24 23:52:53 -04:00
Brandon Thomas adabd2b588 bump server version to 0.9.0 2016-10-22 19:21:28 -04:00
Brandon Thomas 9b12fbacdc Pass tokens to synthesizer intead of strings
- Enables "pauses" for punctuation
- Enables "filler words" like "uh" for unknown words
2016-10-22 18:18:11 -04:00
Brandon Thomas aa9f5e9dad Use IntelliJ-Rust for development; include configs 2016-10-22 01:43:20 -04:00
Brandon Thomas 208f544e36 autofocus 2016-10-20 04:55:11 -04:00
Brandon Thomas cd3bb6a3f2 URL state 2016-10-20 04:10:37 -04:00
Brandon Thomas 66b746f4d2 swap old frontend for new one (without image) 2016-10-20 02:47:57 -04:00
Brandon Thomas c6840a88d4 Begin new frontend code 2016-10-20 02:39:26 -04:00
Brandon Thomas 5fc8f0610c Move old typescript code to new frontend directory 2016-10-20 00:46:22 -04:00
Brandon Thomas 31eb0ea2b7 Move old frontend UI code to new directory 2016-10-20 00:35:15 -04:00
Brandon Thomas b9e199f08d Responsive versions of each. 2016-10-18 03:38:53 -04:00
Brandon Thomas 053dbda1e2 rename 2016-10-18 03:30:15 -04:00
Brandon Thomas bae724525d First iteration on new UI 2016-10-18 03:28:43 -04:00
Brandon Thomas c6c3084a07 Cleanup handler setup, static asset serving 2016-10-18 03:10:59 -04:00
Brandon Thomas beb8303884 Static HTML handler
Maybe slightly wasted effort, but maps routes to static HTML files.
Will be good for doing several demos / concepts and hosting the old UI.
2016-10-18 01:39:02 -04:00
Brandon Thomas 1efcb1e0d5 dictionary updates 2016-10-16 23:49:06 -04:00
Brandon Thomas 49547edf42 5-phones 2016-10-15 23:32:16 -04:00
Brandon Thomas 46961eb43d w/ with 2016-10-15 19:11:00 -04:00
Brandon Thomas a70151d1f1 add "o'clock" to times 2016-10-15 17:46:41 -04:00
Brandon Thomas a3ecab05f0 Time parsing 2016-10-15 17:32:56 -04:00
Brandon Thomas 493749a86d time tokenizing 2016-10-14 02:44:19 -04:00
Brandon Thomas 52f986ad0d Twitter username and hashtag parsing 2016-10-13 03:22:08 -04:00
Brandon Thomas 86155ea998 Update build script, bump version number 2016-10-13 01:30:43 -04:00
Brandon Thomas 202c290e1f CamelCase parsing to word expansion 2016-10-13 01:23:15 -04:00
Brandon Thomas e00d8abe0e Parse hyphenated words into words if in dictionary 2016-10-13 00:55:16 -04:00
Brandon Thomas e8ab38fda0 Cleanup symbol pattern matching 2016-10-13 00:08:31 -04:00
Brandon Thomas 376b19fc06 Currency symbol tokenizing 2016-10-12 23:50:04 -04:00
Brandon Thomas 514656f296 additional test 2016-10-12 22:44:36 -04:00
Brandon Thomas 0c4a69ba4a CamelCase tokenizing 2016-10-12 22:42:41 -04:00
Brandon Thomas c0a284a1ac Tokenize (but do not parse) hyphenated words 2016-10-12 22:05:04 -04:00
Brandon Thomas fd45d9416a plus symbol 2016-10-12 21:41:09 -04:00
Brandon Thomas dbc776292a easier to read logs; dictionary tweaks 2016-10-12 02:04:44 -04:00
Brandon Thomas 90d91f731f ordinal bugfix 2016-10-12 00:24:49 -04:00
Brandon Thomas bb5d9aca1c Ordinal tokenization and rendering 2016-10-11 23:57:51 -04:00
Brandon Thomas 3228cf5e12 Add state abbreviations
Only some work since there are arpabet entries. I don't care to override
them at this time.
2016-10-11 21:50:30 -04:00
Brandon Thomas c319b82462 add arpabet words, remove parens, etc. 2016-10-11 03:59:52 -04:00
Brandon Thomas f9fd557a27 log timing 2016-10-10 04:02:38 -04:00
Brandon Thomas 03a3e24d8b Handle percentages 2016-10-10 03:44:23 -04:00
Brandon Thomas 3f29bed4ad get rid of junk (square brackets, asterisk, etc.) 2016-10-10 03:31:37 -04:00
Brandon Thomas 635cd41fbe Bump server version 2016-10-10 03:07:48 -04:00
Brandon Thomas 28aee28c12 Number parsing
Enables audio synthesis of numbers.
2016-10-10 03:04:01 -04:00
Brandon Thomas 535829e791 Add TODO file to keep track of goals 2016-10-09 18:51:41 -04:00
Brandon Thomas 99f84354ad Add an abbreviations system
- Abbreviations file maps abbreviations to a word list.

- This will function diffrently than initialisms, which are pronounced
  letter by letter.
2016-10-09 18:40:07 -04:00
Brandon Thomas 4557780803 Updates to deploy script 2016-10-08 17:02:10 -04:00
Brandon Thomas 86a3aeef09 Bump server version 2016-10-08 14:30:07 -04:00
Brandon Thomas 9b8263815b Improved code and quality of tokenization
- Distinct rounds of tokenization
- Split into modules
- Cleanup
2016-10-08 14:28:11 -04:00
Brandon Thomas 1850dfe418 dashes and emoji tokenization, added tests
- emoji tokenization is WIP
2016-10-06 03:26:40 -04:00
Brandon Thomas 18b3e0cfdf Bump server version 2016-10-06 02:50:50 -04:00
Brandon Thomas 6524be41e1 Configurable logging contexts; refactored logging
Logging from each component (parsing, synthesis, HTTP server) now logs
as its own target. Configuration options enable turning on or off each
component so it's easy to isolate a component for debugging.
2016-10-06 02:46:29 -04:00
Brandon Thomas c37c07efc0 Update configs based on the system in tweetspeak
configs have a default set and a hostname-specified set that act as
overrides.
2016-10-06 01:27:09 -04:00
Brandon Thomas 343c7f7092 Actually implement a tokenizing pipeline
Split "tokenizing" and "parsing". It isn't quite CS theory, but it makes
things easier to test and maintain.
2016-10-06 00:59:00 -04:00
Brandon Thomas ca2d3eb2b7 Bump hound (wav library) major version 2016-10-03 22:22:28 -04:00
Brandon Thomas 6eadf185d2 Bump dependency versions 2016-10-03 22:20:32 -04:00
Brandon Thomas 5fc4592369 fix smart quote 2016-10-03 22:18:30 -04:00
Brandon Thomas ea0fb8efcc fix emdashes, smart quotes, periods w/ quotes 2016-10-02 17:29:42 -04:00
Brandon Thomas f74f93da1c Bump server version 2016-10-02 16:35:02 -04:00
Brandon Thomas c7224d4838 Cleanup, fix compile warnings 2016-10-02 16:32:56 -04:00
Brandon Thomas f86f6aa3ea Foundations for sentence tokenization (WIP)
- Sentence parsing and correction moved into a single module
- Typesafe "Speaker" parameter
- Regex + lazy_static!
2016-10-02 15:28:48 -04:00
Brandon Thomas 3a6b201ae0 Deploy script 2016-09-30 01:41:17 -04:00
Brandon Thomas 13ba34d0b3 words, readme 2016-09-27 05:16:03 -04:00
Brandon Thomas 7e302e7665 Word audio spacing params + handler cleanup 2016-09-20 05:19:16 -04:00
Brandon Thomas 4ce9909b4e Add work-related dictionary for fun 2016-09-20 04:27:06 -04:00
Brandon Thomas d9352990c7 Add new words 2016-09-20 02:13:02 -04:00
Brandon Thomas 952db53020 Add more words (jigglypuff!) 2016-09-20 01:49:17 -04:00
Brandon Thomas 59f29166ea more words 2016-09-18 07:58:47 -04:00
Brandon Thomas ec72a3c832 Rename "_words" directory to "words" 2016-09-18 06:22:22 -04:00
Brandon Thomas 4e9ce2628f additions to arpabet dictionary 2016-09-18 04:46:39 -04:00
Brandon Thomas 6cb4dac63b Support - in arpabet. 2016-09-18 01:43:51 -04:00
Brandon Thomas 196744b976 Fix bug 2016-09-18 00:49:20 -04:00
Brandon Thomas a2850f63ee dictionary work, etc. 2016-09-16 04:00:24 -04:00
Brandon Thomas 931f195347 Extra phonemes, fixup words 2016-09-16 02:18:10 -04:00
Brandon Thomas 91d0ab9e67 Improved monophones wrt. ends 2016-09-16 02:17:40 -04:00
Brandon Thomas a5dcdca16e Custom arpabet dictionary 2016-09-16 02:08:47 -04:00
Brandon Thomas c80cf6715a Add start/end concept to the n-phone-based synth 2016-09-16 02:06:34 -04:00
Brandon Thomas b2d2d48894 I'm going to hell for some of these words :P 2016-09-13 00:50:21 -04:00
Brandon Thomas 65a3dcad7b maintain own "cleared" state in UI 2016-09-10 18:34:37 -04:00
Brandon Thomas 0e8a469db1 added more missing words 2016-09-10 18:25:49 -04:00
Brandon Thomas e87bb21475 UI improvements 2016-09-10 18:20:10 -04:00
Brandon Thomas 6e7afc677a Forgot to check this in awhile ago 2016-09-10 17:56:30 -04:00
Brandon Thomas 990faf3092 Add a WaveForm UI component (WaveSufer)
- Drop buzz.js for wavesurfer.js
- Wrapper in TypeScript / Webpack instead of Javascript / Gulp
2016-09-10 17:55:19 -04:00
Brandon Thomas 9004b204ed Fix n-phone bug 2016-09-10 12:40:57 -04:00
Brandon Thomas 23bd68c761 Allow apostrophe - fix in arpabet regex 2016-09-10 03:21:22 -04:00
Brandon Thomas c7b34146af cleanup, words 2016-09-08 05:32:30 -04:00
Brandon Thomas b0169fac5e Added a file tracking words I need to add 2016-09-08 04:40:20 -04:00
Brandon Thomas 93f3a2d372 Synthesize using n-phones!
n-phones comprise monophones, diphones, 3-phones, and more.
This algorithm allows for smoother sounding synthesis.

Also updates the UI for a new n-phones option and adds/updates
scripts related to the arpabet with respect to n-phones.
2016-09-08 04:36:49 -04:00
Brandon Thomas a6eb7ad539 Script to determine longest lengths of phonemes 2016-09-07 01:49:53 -04:00
Brandon Thomas 9b0e4d4a8c Add arpabet n-phone histogram tool 2016-09-06 23:59:49 -04:00
Brandon Thomas 4425d17d29 Serverside + UI for making diphones an option 2016-09-06 03:38:56 -04:00
Brandon Thomas c9f0613dd3 Add initial diphone support! 2016-09-06 03:26:17 -04:00
Brandon Thomas 24faba4af1 add "start" and "end" syllables 2016-09-06 00:31:33 -04:00
Brandon Thomas 9fadaa3a55 fix boolean defaults again 2016-09-02 01:11:37 -04:00
Brandon Thomas 9c507e5a47 fix UI bugs (non-persist checkbox, etc.) 2016-09-02 01:05:23 -04:00
Brandon Thomas 159eff2a1e Added phoneme padding params and pause synthesis 2016-09-02 00:20:10 -04:00
Brandon Thomas 489aff2540 Ability to change speed + UI; also refactor volume
- Speed is an effect that stretches the waveform.
- Volume is now an effect.
- Poor UI added for speed component.
2016-09-01 02:04:41 -04:00
Brandon Thomas 740e3c7eec really fix phoneme wavspec bug ! 2016-08-30 02:17:44 -04:00
Brandon Thomas 0009f9b034 turn on/off caching with config option 2016-08-30 02:06:53 -04:00
Brandon Thomas 6fd6581324 Add username creation details 2016-08-30 01:35:30 -04:00
Brandon Thomas b24f5102c0 More readme updates 2016-08-30 01:08:47 -04:00
Brandon Thomas cbe6a2d7db Add nginx config to readme 2016-08-30 00:59:44 -04:00
Brandon Thomas 9a9fbacde1 fix small _blank bug on phoneme-only 2016-08-29 23:55:28 -04:00
Brandon Thomas 04c06bbba4 use_phonemes, use_words options 2016-08-29 22:40:57 -04:00
Brandon Thomas de8a8636b4 Upgrade Iron HTTP stack 2016-08-29 22:13:41 -04:00
Brandon Thomas cf70aebc7e prep for new parameters (need to upgrade iron) 2016-08-29 22:04:56 -04:00
Brandon Thomas 6ada19f32c hack to work on local and prod environments 2016-08-26 01:51:16 -04:00
Brandon Thomas 6c0c0118ff add static to unmapped (word->phonemes) 2016-08-24 03:36:24 -04:00
Brandon Thomas 9f3b0b8059 cleanup, minor safety improvements 2016-08-24 03:25:52 -04:00
Brandon Thomas f90fe671ff Synthesis with phonemes
Changes the filesystem structure a bit, introduces new wave file
reader and dictionaries, etc.
2016-08-24 03:03:21 -04:00
Brandon Thomas ae55dd9514 Read CPU Arpabet dictionary 2016-08-23 03:04:07 -04:00
Brandon Thomas 32a6d5f259 Add Regex dependency 2016-08-23 02:18:53 -04:00
Brandon Thomas 4605b00206 minor update to readme, script wrt phoneme 2016-08-23 00:31:23 -04:00
Brandon Thomas ea9249a62a Merge branch 'master' of github.com:echelon/trumpet 2016-08-22 02:18:10 -04:00
Brandon Thomas 5d56da645a README, word-phoneme dict, phoneme progress script
- Updated README a little
- Added a word-to-phoneme dictionary (CMU open source)
- Added a Python script to track progress on phonemes
2016-08-22 02:16:47 -04:00
Brandon Thomas 4f79e3d719 get system hostname 2016-08-02 01:29:51 -04:00
Brandon Thomas 730b81a9d9 get system hostname 2016-06-25 21:23:53 -04:00
Brandon Thomas b0be23f618 Add TypeScript/Webpack based test page 2016-06-25 18:11:29 -04:00
Brandon Thomas 6325246417 Added a /test route 2016-06-25 01:37:16 -04:00
Brandon Thomas cbb1a128fe Read a config file for paths 2016-06-18 01:58:37 -04:00
Brandon Thomas 29af59d8f3 uncommitted praat changes 2016-06-18 00:51:52 -04:00
Brandon Thomas f0fdba9ee5 example praat scripts 2016-04-29 01:33:30 -04:00
Brandon Thomas d59e5403ed adjust paths 2016-04-26 01:44:57 -04:00
Brandon Thomas d5b7ab92a0 Add Praat segment script found online 2016-04-26 01:42:49 -04:00
Brandon Thomas d4280bb399 Add a spectrogram script found online 2016-04-10 01:50:21 -04:00
Brandon Thomas efee5a8bce cleanup 2016-03-06 04:51:39 -05:00
Brandon Thomas cc3300e0a3 cleanup rust handler 2016-03-06 04:50:50 -05:00
Brandon Thomas 3f9b37c28b Slight cleanup of UI for volume 2016-03-06 04:34:15 -05:00
Brandon Thomas 8d2637ea72 JS/UI for sending volume 2016-03-06 04:28:31 -05:00
Brandon Thomas 91a61537bb Fixed volume parameter 2016-03-06 04:10:34 -05:00
Brandon Thomas e6d8b1dbdb rust server: volume request parameter 2016-03-06 03:19:04 -05:00
Brandon Thomas 1c709b582e cleanup python loudness script 2016-03-06 02:30:54 -05:00
Brandon Thomas 8349bad20f Python script to make WAV files louder 2016-03-06 01:31:08 -05:00
Brandon Thomas 203bafb79e fixup esc key binding 2016-02-11 06:57:50 -05:00
Brandon Thomas c10819df72 form autocomplete off, link to JSON endpoint 2016-02-11 06:50:24 -05:00
Brandon Thomas 12bfb9274f fix voice initialization errors 2016-02-11 06:41:45 -05:00
Brandon Thomas 86ab91e082 URLs are stable for both speakers now 2016-02-11 06:31:10 -05:00
Brandon Thomas d8767823b9 title change 2016-02-11 05:42:03 -05:00
Brandon Thomas 0025cb81db mobile ui fix, stats fix, typeahead state fix 2016-02-11 05:38:37 -05:00
Brandon Thomas e24c87c76f basic dropdown support (still wip w/ URL, style) 2016-02-11 05:25:56 -05:00
Brandon Thomas 717b5a3758 rust audio synth backend is multi-voice 2016-02-11 05:10:08 -05:00
Brandon Thomas 266ac9cbc1 javascript rewrite (/speak endpoint still WIP) 2016-02-11 04:15:51 -05:00
Brandon Thomas 7658d602e2 frontend rewrite (wip, not working) 2016-02-10 04:30:40 -05:00
Brandon Thomas c1860ee33d reorganize 2016-02-10 04:11:01 -05:00
Brandon Thomas 9555aeff18 serve new JSON payload (incomplete) 2016-02-10 04:07:20 -05:00
Brandon Thomas 08be337ae0 Adding dictonary of words read 2016-02-10 03:45:01 -05:00
Brandon Thomas 62758a7285 play sounds with buzz.js 2016-02-10 02:12:31 -05:00
Brandon Thomas 44fe6d4cdf minify, set ui color state 2016-02-02 04:43:34 -05:00
Brandon Thomas 00c0930d0a cleanup javascript 2016-02-02 04:34:53 -05:00
Brandon Thomas 9c4bdd76ff Autoplay / URL change state 2016-02-02 04:27:12 -05:00
Brandon Thomas 811a86af0b Sentence padding, word count stats, etc. 2016-02-01 05:38:29 -05:00
Brandon Thomas 31399665f9 really crude typeahead ui 2016-01-26 03:26:29 -05:00
Brandon Thomas 98b5aef641 add empty sounds/ dir 2016-01-26 02:43:14 -05:00
Brandon Thomas dfa3661a13 Typing now informs UI state 2016-01-24 15:46:32 -05:00
Brandon Thomas 46c9d5486f raw js/dom -> js/jquery 2016-01-24 14:30:48 -05:00
Brandon Thomas aacff3c1ce Gulp/Bower workflow for Javascript 2016-01-24 14:17:55 -05:00
Brandon Thomas 61b169392c ignore bower components 2016-01-24 12:23:45 -05:00
Brandon Thomas 9dcdc2542a Bower for JS dependency management 2016-01-24 12:20:03 -05:00
Brandon Thomas ef11ef421b Add requirements.txt for fabistrano deploys 2016-01-02 05:56:49 -05:00
Brandon Thomas 27e000c9a9 Character encoding, prevent page redirect 2016-01-02 03:47:44 -05:00
Brandon Thomas 4ac33dcef0 CLI option for port number 2016-01-02 03:35:52 -05:00
Brandon Thomas 44dae5d64a Bump dependency versions (hound,etc.) 2015-12-31 22:50:59 -05:00
Brandon Thomas 540e664b19 ETag-based caching 2015-12-11 03:51:11 -05:00
Brandon Thomas b230e2674e Add logger 2015-12-10 05:39:45 -05:00
Brandon Thomas 2b1c0f84bb Cleanup 2015-12-10 05:30:19 -05:00
Brandon Thomas ae59d9fd57 Adding error filters / middleware 2015-12-10 05:24:15 -05:00
Brandon Thomas 57c7114c37 style updates 2015-12-09 05:51:07 -05:00
Brandon Thomas 6c61dfff11 style improvement 2015-12-09 05:37:13 -05:00
Brandon Thomas 720f851343 Web interface 2015-12-09 05:31:30 -05:00
Brandon Thomas 8c937995fa Serve static files 2015-12-09 04:36:15 -05:00
Brandon Thomas 795074d112 audio synth endpoint works 2015-12-08 03:33:27 -05:00
Brandon Thomas 77f0c504df Work in progress on handlers 2015-12-08 01:59:59 -05:00
Brandon Thomas e2ebba0aca Vocab list endpoint returns JSON 2015-12-05 04:12:31 -05:00
Brandon Thomas 357887ec9e Add cargo.lock 2015-12-04 05:00:41 -05:00
Brandon Thomas 08d1989e6e Words from command line arguments 2015-12-04 04:21:55 -05:00
Brandon Thomas e232d20c46 Adding Iron/Hyper server (initial work) 2015-12-04 04:01:58 -05:00
Brandon Thomas 014c15e793 cleanup 2015-12-03 02:54:00 -05:00
Brandon Thomas c0ea0b8fd8 Cleanup.
Sorry for committing all of this to master. I'll rebase and force push
later to cleanup.
2015-08-31 04:30:24 -04:00
Brandon Thomas 321cbe50be WAV codec and some sample data to mix. 2015-08-31 04:26:17 -04:00
Brandon Thomas 093757f635 Trying SDL-mixer 2.0 2015-08-31 01:37:28 -04:00
Brandon Thomas b65fed7b00 Repo init, some Rust deps.
- Initialize repo.
- Include some plausible rust dependencies.
2015-08-30 23:15:08 -04:00
8520 changed files with 701266 additions and 518801 deletions
-56
View File
@@ -1,56 +0,0 @@
# API Conventions
## HTTP Handlers (Actix-Web)
Handlers in `storyteller_web` follow this structure:
1. **Request/Response types** with `#[derive(Deserialize/Serialize, ToSchema)]`
2. **Error enum** implementing `ResponseError`, `Display`, `Serialize`, `ToSchema`
3. **Handler function** annotated with `#[utoipa::path(...)]` for OpenAPI docs
4. Handler returns `Result<Json<Response>, ErrorType>`. Only use `Result<HttpResponse, ErrorType>` when you need to set headers/cookies.
### Error Types
- Use `CommonWebError` for simple handlers that only need standard HTTP error codes
- Use a custom error enum when you need endpoint-specific error variants (e.g. `LoginErrorType::InvalidCredentials`)
- Custom error enums MUST implement `ResponseError` (actix), `Display`, and `Serialize`
- When adding `From<RequireUserSessionError>` or similar conversions, implement them on `CommonWebError` in its own module (orphan rule)
- Error response bodies include: `success: false`, `error_code`, `error_code_str`
### Session/Auth
Helpers live in `storyteller_web` under `http_server/web_utils/user_session/`. Each takes a
generic `mysql_executor: E` (any `sqlx::Executor`), so whether it reuses a connection or acquires
its own depends on the **argument you pass**:
- `require_user_session(http_request, session_checker, mysql_executor)` — require a logged-in user.
- `require_user_session_extended(...)` — same, with extra session detail.
- `require_moderator(http_request, session_checker, mysql_executor)` — admin-only endpoints.
PREFER passing an already-open connection (`&mut *conn`) so the helper reuses it. Passing
`&server_state.mysql_pool` makes it acquire a fresh connection — avoid that when the handler
already holds one (the double-acquire adds pool pressure; this crate has had pool-timeout
incidents). There is no `*_using_connection` variant — the reuse/acquire choice is the argument.
### API Type Definitions
- Shared request/response types go in `artcraft_api_defs` crate (under `crates/api_clients/artcraft/artcraft_api_defs/`)
- Types that need `ResponseError` impl must stay in `storyteller_web` (orphan rule)
- New types must be added to `api_doc.rs` schemas (in storyteller-web) for Swagger generation
## Enums (Database-backed)
- Located in `crates/schema/public/enums/src/by_table/{table_name}/`
- Require manual `to_str()` and `from_str()` implementations
- Use `impl_enum_display_and_debug_using_to_str!` and `impl_mysql_enum_coders!` macros
- Add comprehensive tests: serialization, round-trip, variant count
- YOU CAN ADD NEW VALUES but DO NOT CHANGE EXISTING VALUES without a migration strategy
- Note that adding new values can break older versions of the Tauri desktop app that read
responses over Rust - make sure it consumes variants with an "Unknown(String)" variant
catch-all to future proof the APIs.
## Tokens (Primary Keys)
- Located in `crates/schema/public/tokens/src/tokens/`
- Opaque `String` wrappers with Stripe-like prefixes (e.g. `user_`, `mf_`)
- Use `impl_string_token!`, `impl_mysql_token_from_row!`, `impl_crockford_generator!` macros
-92
View File
@@ -1,92 +0,0 @@
# Code Style
## Rust
- Two spaces for indentation (not four)
- No minimum supported Rust version; use latest stable features freely
- `#[macro_use] extern crate serde_derive;` is used in binary crates; library crates use `use serde_derive::{Serialize, Deserialize};`
- Never use `println!` or `eprintln!` outside of tests; use `log` crate macros (`info!`, `warn!`, `error!`, `debug!`, `trace!`) instead
- Use `anyhow::Result` / `AnyhowResult` for fallible functions in application code; new database queries should use `Result<T, sqlx::Error>` instead
- SQLx: MySQL queries belong in the `mysql_queries` crate. Do NOT write `sqlx::query!` /
`sqlx::query()` in application/service crates (e.g. `storyteller-web`, which has zero direct
SQLx queries) — add or reuse a function in `mysql_queries` and call it. The compile-time
`query!` / `query_as!` macro conventions for that crate are documented in
`crates/schema/database/mysql_queries/CLAUDE.md`.
- Enum Display/Debug: use `impl_enum_display_and_debug_using_to_str!` macro, not `derive_more::Display` (CLion doesn't understand it)
- Fields that are optional use the `maybe_` prefix: `maybe_creator_user_token`, `maybe_prompt_token`
- When implementing `fmt::Display` for error types, use the pattern: `write!(f, "{:?}", self)`
## File Layout (Top-to-Bottom Reading Order)
Organize code so a human reading top-to-bottom encounters the most important things first and
can drill down into details only when curious. Think of it like a newspaper: headline first,
then the story, then the fine print.
### Ordering within a file
1. **Constants** at the top, right after imports.
2. **The primary public type** (the main struct/enum the file is about) comes next.
A reader opening this file should immediately see what it defines.
3. **Supporting/subordinate types** (sub-structs, helper enums, serialization DTOs) go
below the primary type, not above it. Ask: "Would a reader need to know this type
exists before seeing the main type?" — if no, push it down.
4. **Type ordering for API types**: Request, then Response (success), then Error.
5. **`impl` blocks** after their type definitions.
### Ordering within an `impl` block
1. **Constructors** (`new`, `from_*`, `builder`) at the top.
2. **Public methods** next — these are the main entry points a reader cares about.
3. **Private helper methods** below public methods.
- Among helpers: place "meaty" helpers (substantial logic, direct continuations of the
public entry point) above "leaf" helpers (small formatters, simple lookups).
- A method that calls another method in the same file should appear *above* the method
it calls. This lets readers follow the call chain downward.
### Ordering within test modules
Put test cases first, helpers last. A reader opening a test file should immediately see
*what* is being tested before *how* the test machinery works.
1. **Imports**
2. **Constants** (test IDs, URLs, fixture data) — small context that tests reference
3. **Test functions** or **sub-modules** grouped by category
4. **Helper functions** (builders, pipeline runners, assertions)
Group related tests into sub-modules (`mod pricing_tests { ... }`) when a category has 2+
tests. Don't create a sub-module for a single test. Keep nesting to two levels max
(`mod tests { mod category { ... } }`). Shared helpers go in the parent module so
sub-modules can reach them via `use super::*`.
## Naming
- Handler functions: `{verb}_{noun}_handler` (e.g. `get_health_check_handler`, `login_handler`)
- Error enums: `{Feature}Error` (e.g. `FalWebhookError`, `HealthCheckError`)
- Request/response structs: `{Action}Request`, `{Action}Response`, `{Action}SuccessResponse`
- Path params: `{Action}PathInfo`
- Builder structs: `{Thing}Builder` with `set_` prefixed setters and a `build()` method
## Imports
- Group imports: std, external crates, internal workspace crates, `crate::` imports
- Prefer `use` imports over inline fully-qualified paths. Inline qualification is acceptable
only for genuine one-off references where adding an import would be noise, or for types
that collide with std prelude names (`Result`, `Option`, `Error`). If you reference a symbol
more than once, always import it.
- Prefer specific imports over wildcards, except in `api_doc.rs` and test modules
- When two crates export a type with the same name, alias with a suffix describing the source crate:
`use enums::...::CommonResolution as CommonResolutionEnum;`
`use artcraft_router::...::CommonResolution as CommonResolutionRouter;`
This avoids long fully-qualified paths in function signatures and bodies.
## MySQL
- MySQL tables: primary key `id` columns must be `BIGINT(20) UNSIGNED`. Do not use signed IDs.
- Always create tables with `ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_bin`.
## TypeScript / Frontend
- TypeScript with React, Vite, Zustand, Three.js
- Nx monorepo under `crates/frontend/`
- Two spaces for indentation
-73
View File
@@ -1,73 +0,0 @@
# Testing
## Database Fixture Tests
- Live in-crate (e.g. `storyteller-web`'s omni_gen video pricing tests) and
use the `mysql_testing` crate (`crates/schema/database/mysql_testing`) for
guarded pools, schema setup, and account/session/wallet fixtures
- They RUN BY DEFAULT with `cargo test -p storyteller-web` and from the IDE
(requires a local MySQL with an `artcraft_test` database). Machines/CI
without MySQL skip them via the off switch:
`SQLX_OFFLINE=true cargo test -p storyteller-web --features skip_database_tests`
- They connect ONLY via `ARTCRAFT_TEST_DATABASE_URL` (default
`mysql://root:@localhost:3306/artcraft_test`); the guard panics on any
database whose name lacks "test", on `storyteller`/`artcraft`, and on
cloud hosts — see `mysql_testing/README.md`
- Database tests run in PARALLEL: each test creates its own users, wallets,
and rows; schema setup single-flights via a MySQL named lock. Only tests
mutating shared/global state take
`mysql_testing::serial::acquire_serial_test_lock().await`
- External providers must never be called: the harness stubs Kinovi with an
in-process HTTP server via `KINOVI_CUSTOM_API_HOST`/`KINOVI_CUSTOM_CDN_HOST`
## Running Tests
- Most crates: `cargo test -p {crate_name}`
- Crates using SQLx offline mode: `SQLX_OFFLINE=true cargo test -p {crate_name}`
- The `storyteller-web` and `mysql_queries` crates require `SQLX_OFFLINE=true` for compilation
- Use `cargo check -p {crate_name}` for fast compilation checks without running tests
## Test Patterns
- Tests live in `#[cfg(test)] mod tests { ... }` at the bottom of each file
- Group related tests into sub-modules by category (e.g. `mod pricing_tests`, `mod resolution_tests`)
- Only create a sub-module when it has 2+ tests — don't wrap a single test in its own module
- Keep nesting shallow: `mod tests { mod category { ... } }` is fine; a third level is rarely needed
- Shared helpers used by multiple sub-modules belong in the parent `mod tests`, not duplicated in each sub-module
- Enum tests should cover: serialization, deserialization, `to_str`/`from_str` round-trip, variant count
- Password/crypto tests: be mindful of computation cost, don't add too many bcrypt test cases
## Test File Layout
Put test cases first, helpers last. Engineers should see the actual tests before scrolling
to understand helper plumbing.
Within a `mod tests { ... }` block:
1. **Imports** at the top
2. **Constants** (test data IDs, URLs, etc.) — small context that tests reference
3. **Test functions** (`#[test]` / `#[tokio::test]`) grouped by category
4. **Helper functions** (builders, pipeline runners, etc.) at the very bottom
If tests are grouped into sub-modules, the same rule applies within each sub-module:
constants first, then tests, then helpers at the end of that sub-module.
## What to Test
- New error types and their mappings
- Enum variant serialization stability (these are stored in the database)
- Hash/deduplication functions with known inputs
- Edge cases in parsers (empty input, missing fields, malformed data)
## Imports in Tests
- Import test fixtures and constants with `use`, not inline fully-qualified paths.
Write `use test_data::web::image_urls::JUNO_AT_LAKE_IMAGE_URL;` at the top,
then reference `JUNO_AT_LAKE_IMAGE_URL` in test bodies.
- Same rule applies to enum variants used in match arms — import them, don't write
`crate::some::deep::module::MyEnum::Variant` inline.
## What Not to Test
- Don't add integration tests that require a running database unless explicitly asked
- Don't add tests for simple struct construction or trivial getters
+2 -2
View File
@@ -1,4 +1,4 @@
hakari-package = "workspace-build-acceleration"
hakari-package = "my-workspace-hack"
resolver = "1"
@@ -11,4 +11,4 @@ platforms = [
"x86_64-pc-windows-msvc",
]
exact-versions = true
exact-versions = true
+16
View File
@@ -0,0 +1,16 @@
*secret*sh
*~
.dockerignore
.env
.env-secrets
.git
.idea/
Dockerfile
__pycache__/
_ignored_schema.rs
models/Wav2Lip/python/
models/tacotron2/python/
production_database_secret_connect.sh
secrets.toml
secrets.yaml
target/
+78
View File
@@ -0,0 +1,78 @@
SERVER_ENVIRONMENT=development
DATABASE_URL=mysql://storyteller:password@localhost/storyteller
#DATABASE_URL=mysql://root:root@localhost/storyteller
#DATABASE_URL=mysql://root@localhost/storyteller
# Diesel-cli reads this for the migration directory to use.
# We've renamed it so the migrations are sorted near the top of the project directory tree
# (since they kind of serve as documentation)
MIGRATION_DIRECTORY=_sql/migrations/
# SQLX normally requires a live database to reflect upon at build time.
# This setting turns that on and requires a `sql-data.json` cache file instead.
# See https://github.com/launchbadge/sqlx/tree/master/sqlx-cli#readme
#SQLX_OFFLINE=true
# NB(bt, 2023-03-20):
# These are used in storyteller-web, image-generation-service, and websocket-gateway.
# I'm moving them to env configs that live under storyteller-web/.env.
# This will break the other services for now.
# # We can't serve HTTPS locally without self-signed certificate nonsense.
# COOKIE_SECURE=false
# COOKIE_DOMAIN=.jungle.horse
# WEBSITE_HOMEPAGE_REDIRECT=http://jungle.horse
# Bucket config (non-secret)
REGION_NAME=us-east1
TTS_DOWNLOAD_BUCKET_NAME=dev-vocodes-private-uploads
TTS_DOWNLOAD_BUCKET_ROOT=/user_uploaded_tts_models
W2L_PRIVATE_DOWNLOAD_BUCKET_NAME=dev-vocodes-private-uploads
W2L_PUBLIC_DOWNLOAD_BUCKET_NAME=dev-vocodes-public
PRIVATE_BUCKET_NAME=dev-vocodes-private-uploads
PUBLIC_BUCKET_NAME=dev-vocodes-public
# Bucket roots
AUDIO_UPLOADS_BUCKET_ROOT=/user_uploaded_w2l_audio
W2L_DOWNLOAD_BUCKET_ROOT=/user_uploaded_w2l_templates
W2L_INFERENCE_OUTPUT_BUCKET_ROOT=/w2l_output
W2L_CODE_DIRECTORY=/home/bt/dev/storyteller/storyteller-web/models/Wav2Lip
W2L_INFERENCE_SCRIPT_NAME=vocodes_process_inference.py
W2L_MODEL_FILENAME=wav2lip_gan.pth
#W2L_MODEL_CHECKPOINT=/home/bt/models/wav2lip/s3fd-619a316812.pth
W2L_MODEL_CHECKPOINT=/home/bt/models/wav2lip/wav2lip_gan.pth
W2L_END_BUMP_FILENAME=vocodes-short-end-bump.mp4
W2L_DOWNLOAD_SCRIPT_NAME=vocodes_process_upload.py
TTS_CODE_DIRECTORY=/home/bt/dev/storyteller/storyteller-ml/tts
TTS_INFERENCE_SCRIPT_NAME=vocodes_inference.py
TACOTRON_ROOT_CODE_DIRECTORY=/home/bt/dev/storyteller/storyteller-ml/tts
TACOTRON_VIRTUAL_ENV_ACTIVATION_COMMAND="source python/bin/activate"
TACOTRON_MODEL_CHECK_SCRIPT_NAME="vocodes_model_check_tacotron.py"
TALKNET_ROOT_CODE_DIRECTORY=/home/bt/dev/storyteller/storyteller-ml/tts
TALKNET_MODEL_CHECK_SCRIPT_NAME="vocodes_model_check_talknet.py"
HIFIGAN_ROOT_CODE_DIRECTORY=/home/bt/dev/storyteller/storyteller-ml/tts
HIFIGAN_VIRTUAL_ENV_ACTIVATION_COMMAND="source python/bin/activate"
HIFIGAN_MODEL_CHECK_SCRIPT_NAME="vocodes_model_check_hifigan.py"
TTS_INFERENCE_SIDECAR_HOSTNAME=localhost:8000
#TTS_WAVEGLOW_VOCODER_MODEL_FILENAME=waveglow_256channels_universal_v5.pt # THIS SOUNDS HORRID
#TTS_WAVEGLOW_VOCODER_MODEL_FILENAME=waveglow_256channels_v4_uberduck.pt # THIS IS TOO SMALL! 300MB vs 1.2 GB!
TTS_WAVEGLOW_VOCODER_MODEL_FILENAME=waveglow_256channels_v4.pt
TTS_HIFIGAN_VOCODER_MODEL_FILENAME=hifigan_universal_g_02500000.pt
TTS_HIFIGAN_SUPERRES_VOCODER_MODEL_FILENAME=hifigan_superres_twilight_33000.pt
# Development key. Permissible to check in.
NEWRELIC_API_KEY=c402be1c4c4216ec83d0cfc0851520cfFFFFNRAL
STORYTELLER_ROOT="/home/tensor/code/storyteller/"
@@ -1,237 +0,0 @@
name: "Artcraft MacOS Publish"
on:
push:
branches:
- release
- artcraft-release
- artcraft-macos # Additional branch for MacOS testing
# This workflow creates Universal macOS builds with signing certificate support.
# On each push to the release branches it will create or update a GitHub release, build your app, and upload the artifacts to the release.
jobs:
publish-artcraft:
permissions:
contents: write
strategy:
fail-fast: false
matrix:
include:
# Universal macOS builds (arm64 and x86_64)
- platform: 'macos-latest-xlarge'
args: '--target universal-apple-darwin'
# Uncomment below for additional platforms
# - platform: 'ubuntu-22.04'
# args: ''
# - platform: 'windows-latest'
# args: ''
runs-on: ${{ matrix.platform }}
steps:
- uses: actions/checkout@v4
- name: setup node
uses: actions/setup-node@v4
with:
node-version: lts/*
- name: install Rust stable
uses: dtolnay/rust-toolchain@stable
with:
targets: ${{ matrix.platform == 'macos-latest-xlarge' && 'aarch64-apple-darwin,x86_64-apple-darwin' || '' }}
- name: install dependencies (ubuntu only)
if: matrix.platform == 'ubuntu-22.04'
run: |
sudo apt-get update
sudo apt-get install -y libwebkit2gtk-4.1-dev libappindicator3-dev librsvg2-dev patchelf
- name: replace tauri config with mac-specific version
run: |
pushd ${{ github.workspace }}/crates/desktop/artcraft
# Use the mac-specific tauri conf for the build
# TODO(bt): Replace this with the platform-specific naming conventions
cp tauri-mac.conf.json tauri.conf.json
popd
- name: install frontend dependencies
run: |
# Navigate to the frontend directory to install dependencies
cd ./frontend
npm cache clean --force
echo "Installing all workspace dependencies..."
npm ci
echo "=== Version Information ==="
echo "Node version:"
node --version
echo "NPM version:"
npm --version
echo "=== Nx versions from lockfile ==="
npm list --depth=0 | grep nx
- name: import Apple Developer Certificate
if: matrix.platform == 'macos-latest-xlarge'
env:
APPLE_CERTIFICATE: ${{ secrets.APPLE_CERTIFICATE }}
APPLE_CERTIFICATE_PASSWORD: ${{ secrets.APPLE_CERTIFICATE_PASSWORD }}
KEYCHAIN_PASSWORD: ${{ secrets.KEYCHAIN_PASSWORD }}
run: |
echo "Starting certificate import process..."
# Create certificate file
echo $APPLE_CERTIFICATE | base64 --decode > certificate.p12
# Debug: Check if certificate file exists and has content
echo "Certificate file info:"
ls -la certificate.p12
file certificate.p12
# Debug: Check certificate contents without password (just structure)
echo "Certificate structure (may show error if password protected):"
openssl pkcs12 -info -in certificate.p12 -passin pass:$APPLE_CERTIFICATE_PASSWORD -noout || echo "Could not read certificate structure"
# Debug: Try to list what's in the p12 file
echo "Attempting to list certificate contents:"
security cms -D -i certificate.p12 || echo "Not a CMS file, trying PKCS12..."
openssl pkcs12 -in certificate.p12 -passin pass:$APPLE_CERTIFICATE_PASSWORD -info -nodes 2>&1 | head -20 || echo "Failed to read PKCS12 contents"
# Debug: Extract certificate details to verify type and expiration
echo "Extracting certificate details..."
# Extract just the certificate portion and examine it
openssl pkcs12 -in certificate.p12 -passin pass:$APPLE_CERTIFICATE_PASSWORD -nokeys 2>/dev/null | openssl x509 -text -noout | grep -E "(Subject:|Issuer:|Not Before|Not After)" || echo "Failed to parse certificate details"
# Also try to see what type of certificate this is
echo "Certificate type check:"
openssl pkcs12 -in certificate.p12 -passin pass:$APPLE_CERTIFICATE_PASSWORD -nokeys 2>/dev/null | openssl x509 -text -noout | grep -E "(CN=|OU=)" || echo "Could not determine certificate type"
# Debug: Check if private key exists
echo "Checking for private key..."
openssl pkcs12 -in certificate.p12 -passin pass:$APPLE_CERTIFICATE_PASSWORD -nocerts -nodes 2>&1 | grep -E "(PRIVATE KEY|RSA KEY)" | head -5 || echo "No private key found"
# Create temporary keychain
security create-keychain -p "$KEYCHAIN_PASSWORD" build.keychain
security default-keychain -s build.keychain
security unlock-keychain -p "$KEYCHAIN_PASSWORD" build.keychain
security set-keychain-settings -t 3600 -u build.keychain
# Import certificate - ensure both certificate and private key are imported
echo "Importing certificate into keychain..."
# Import the p12 directly - this is the most reliable method
security import certificate.p12 -k build.keychain -P "$APPLE_CERTIFICATE_PASSWORD" -T /usr/bin/codesign -T /usr/bin/security -T /usr/bin/productbuild
# Alternative: Try with additional flags if the first import didn't create an identity
echo "Verifying import..."
if ! security find-identity -v build.keychain | grep -q "1 valid identities found"; then
echo "First import didn't create identity, trying with -A flag..."
security import certificate.p12 -k build.keychain -P "$APPLE_CERTIFICATE_PASSWORD" -A
fi
# Set trust settings for the certificate
echo "Setting trust settings..."
security set-key-partition-list -S apple-tool:,apple:,codesign: -s -k "$KEYCHAIN_PASSWORD" build.keychain
# Unlock the keychain again to ensure it's accessible
security unlock-keychain -p "$KEYCHAIN_PASSWORD" build.keychain
# Add the keychain to the search list
security list-keychains -d user -s build.keychain $(security list-keychains -d user | sed 's/^[[:space:]]*"//;s/"$//')
# List all certificates to debug
echo "Listing all keychains:"
security list-keychains
echo "Listing all certificates in build keychain:"
security find-certificate -a -p build.keychain || echo "No certificates found"
echo "Detailed certificate info:"
security find-certificate -c "Learning Machines" build.keychain || echo "Certificate 'Learning Machines' not found"
# Check certificate trust settings
echo "Checking certificate trust settings:"
security dump-trust-settings || echo "No custom trust settings"
# Try to find codesigning identities
echo "Finding all identities in keychain:"
security find-identity -v build.keychain || echo "No identities found"
echo "Finding codesigning identities:"
security find-identity -v -p codesigning build.keychain || echo "No codesigning identities found"
# Additional debug: Check if this is a valid Developer ID cert
echo "Checking for Developer ID certificates:"
security find-certificate -a build.keychain | grep -A 5 -B 5 "Developer ID" || echo "No Developer ID certificates found"
- name: verify certificate
if: matrix.platform == 'macos-latest-xlarge'
run: |
echo "=== Certificate Verification ==="
echo "1. Checking codesigning identities:"
security find-identity -v -p codesigning build.keychain || echo "No codesigning identities found"
echo -e "\n2. Checking all identities:"
security find-identity -v build.keychain || echo "No identities found"
echo -e "\n3. Checking certificates in keychain:"
security find-certificate -c "Learning Machines" build.keychain -p | openssl x509 -text -noout | grep -E "(Subject:|CN=)" || echo "Could not parse certificate"
# Set the correct signing identity
echo "APPLE_SIGNING_IDENTITY=Developer ID Application: Learning Machines LLC (DJ6XS33FX8)" >> $GITHUB_ENV
echo "Proceeding with identity: Developer ID Application: Learning Machines LLC (DJ6XS33FX8)"
# Also set the team ID
echo "APPLE_DEVELOPMENT_TEAM=DJ6XS33FX8" >> $GITHUB_ENV
- name: Pre-build frontend to avoid Tauri build issues
run: |
# Build the frontend app from the correct directory
cd ./frontend
# Increase Node.js memory limit for the build
export NODE_OPTIONS="--max-old-space-size=8192"
# Use npx to ensure we use the local nx version
echo "Building with npx nx..."
npx nx run artcraft:build
echo "Checking build output..."
ls -la apps/artcraft/dist/ | head -10
# Update Tauri config to skip the build (since we already built)
cd ${{ github.workspace }}/crates/desktop/artcraft
cp tauri.conf.json tauri.conf.json.bak
# Set beforeBuildCommand to empty or a no-op command
if command -v jq &> /dev/null; then
jq '.build.beforeBuildCommand = ""' tauri.conf.json > tauri.conf.json.tmp
mv tauri.conf.json.tmp tauri.conf.json
else
node -e "const fs = require('fs'); const config = JSON.parse(fs.readFileSync('tauri.conf.json', 'utf8')); config.build.beforeBuildCommand = ''; fs.writeFileSync('tauri.conf.json', JSON.stringify(config, null, 2));"
fi
- name: build and publish
uses: tauri-apps/tauri-action@v0
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
APPLE_ID: ${{ secrets.APPLE_ID }}
APPLE_ID_PASSWORD: ${{ secrets.APPLE_ID_PASSWORD }}
APPLE_PASSWORD: ${{ secrets.APPLE_PASSWORD }}
APPLE_TEAM_ID: ${{ secrets.APPLE_TEAM_ID }}
APPLE_CERTIFICATE_PASSWORD: ${{ secrets.APPLE_CERTIFICATE_PASSWORD }}
APPLE_SIGNING_IDENTITY: ${{ env.APPLE_SIGNING_IDENTITY }}
APPLE_DEVELOPMENT_TEAM: ${{ env.APPLE_DEVELOPMENT_TEAM }}
# Use the SQLx query cache for SQLite
SQLX_OFFLINE: true
with:
projectPath: ./crates/desktop/artcraft
tagName: artcraft-v__VERSION__ # the action automatically replaces __VERSION__ with the app version.
releaseName: "ArtCraft v__VERSION__"
releaseBody: "See the assets below to download this version and install."
releaseDraft: true
prerelease: false
args: ${{ matrix.args }}
@@ -1,107 +0,0 @@
name: "Artcraft Windows Publish"
on:
push:
branches:
- release
- artcraft-release
- artcraft-windows # Additional branch for Windows testing
# This workflow creates Windows builds.
# On each push to the release branches it will create or update a GitHub release, build your app, and upload the artifacts to the release.
jobs:
publish-artcraft-windows:
permissions:
contents: write
strategy:
fail-fast: false
matrix:
include:
# Windows builds
- platform: 'windows-latest'
args: ''
runs-on: ${{ matrix.platform }}
steps:
- uses: actions/checkout@v4
- name: install Rust stable
uses: dtolnay/rust-toolchain@stable
- name: install wreq dependencies
run: |
choco install cmake -y
choco install strawberryperl -y
choco install pkgconfiglite -y
choco install llvm -y
choco install nasm -y
shell: cmd
- name: setup node
uses: actions/setup-node@v4
with:
node-version: lts/*
- name: install frontend dependencies
run: |
# Navigate to the frontend directory to install dependencies
cd ./frontend
npm cache clean --force
echo "Installing all workspace dependencies..."
npm ci
echo "=== Version Information ==="
echo "Node version:"
node --version
echo "NPM version:"
npm --version
echo "=== Nx versions from lockfile ==="
npm list --depth=0 | findstr nx
- name: Pre-build frontend to avoid Tauri build issues
run: |
# Build the frontend app from the correct directory
cd ./frontend
# Increase Node.js memory limit for the build
$env:NODE_OPTIONS="--max-old-space-size=8192"
# Use npx to ensure we use the local nx version
echo "Building with npx nx..."
npx nx run artcraft:build
if ($LASTEXITCODE -ne 0) {
exit $LASTEXITCODE
}
echo "Checking build output..."
dir apps/artcraft/dist/ | Select-Object -First 10
# Update Tauri config to skip the build (since we already built)
cd ${{ github.workspace }}/crates/desktop/artcraft
Copy-Item tauri.conf.json tauri.conf.json.bak
# Set beforeBuildCommand to empty using PowerShell
$config = Get-Content tauri.conf.json | ConvertFrom-Json
$config.build.beforeBuildCommand = ""
$config | ConvertTo-Json -Depth 10 | Set-Content tauri.conf.json
- name: build and publish
uses: tauri-apps/tauri-action@v0
env:
# NB(bt): This is needed by wreq. Hopefully it doesn't kill Tauri
RUSTFLAGS: "-C target-feature=+crt-static"
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
# Use the SQLx query cache for SQLite
SQLX_OFFLINE: true
with:
projectPath: ./crates/desktop/artcraft
tagName: artcraft-v__VERSION__ # the action automatically replaces __VERSION__ with the app version.
releaseName: "ArtCraft v__VERSION__"
releaseBody: "Production build of ArtCraft. See the assets below to download and install."
releaseDraft: true
prerelease: false
args: ${{ matrix.args }}
+115
View File
@@ -0,0 +1,115 @@
# Adapted from
# https://github.com/actions/starter-workflows/ci/docker-publish.yml
# If using base images, don't forget to add READ access, eg. from a package settings page like:
# https://github.com/orgs/storytold/packages/container/docker-base-images-rust-ssl/settings/actions_access
name: "[CPU] Build GHCR Docker artifact"
on:
push:
branches:
# NB: Default-branch doesn't work, despite Github's documentation.
#- $default-branch
- master
env:
IMAGE_NAME: storyteller-rust
jobs:
# Push image to GitHub Packages.
# See also https://docs.docker.com/docker-hub/builds/
# See also https://depot.dev/blog/docker-layer-caching-in-github-actions
# See also https://evilmartians.com/chronicles/build-images-on-github-actions-with-docker-layer-caching
build-docker-image:
name: "Build Docker Image"
#runs-on: ubuntu-22.04 # runs-on: ubuntu-latest
#runs-on: github-ubuntu-16core # NB: Premium GitHub runner with more cores
runs-on: github-ubuntu-64core # NB: Premium GitHub runner with more cores
if: github.event_name == 'push'
permissions:
packages: write
contents: read
steps:
- uses: actions/checkout@v3
# - uses: docker/setup-buildx-action@v1
# name: Set up Docker Buildx
- uses: docker/login-action@v1
name: Login to GitHub Container Registry
with:
registry: ghcr.io
username: ${{ github.actor }} # username: ${{ github.repository_owner }}
password: ${{ secrets.GITHUB_TOKEN }}
- name: Calculate short SHA
id: vars
# echo "sha_short=$(git rev-parse --short HEAD)" >> $GITHUB_OUTPUT
run: |
echo "sha_short=$(echo ${{ github.sha }} | cut -c1-12)" >> $GITHUB_OUTPUT
- name: Emit short SHA
run: |
echo "Full SHA: ${{ github.sha }}"
echo "Short SHA: ${{ steps.vars.outputs.sha_short }}"
#- uses: actions/cache@v2
# name: Cache Docker layers
# with:
# path: /tmp/.buildx-cache
# key: ${{ runner.os }}-buildx-${{ github.sha }}
# restore-keys: |
# ${{ runner.os }}-buildx-
# Docs for this action are at https://github.com/marketplace/actions/build-docker-images-using-cache
- uses: whoan/docker-build-with-cache-action@v6
with:
registry: ghcr.io
username: ${{ github.actor }} # username: ${{ github.repository_owner }}
password: ${{ secrets.GITHUB_TOKEN }}
image_name: storytold/storyteller-rust
dockerfile: service_cpu.Dockerfile
# NB: The `git_push_tag: true` option does not work as expected, so we put the sha in `image_tag`:
# https://github.com/whoan/docker-build-with-cache-action/issues/72
image_tag: latest,${{ github.sha }},${{ steps.vars.outputs.sha_short }}
# NB: Inject the Git SHA into the container so the servers can emit their own version:
build_extra_args: "--build-arg=GIT_SHA=${{ github.sha }}"
# - name: Build image
# run: |
# SHORT_SHA=$(echo ${GITHUB_SHA} | cut -c1-12)
# docker build . --file Dockerfile --tag $IMAGE_NAME --label "runnumber=${GITHUB_RUN_ID}" --build-arg GIT_SHA=${SHORT_SHA}
# - name: Push image to GitHub Container Registry
# run: |
# IMAGE_ID=ghcr.io/${{ github.repository_owner }}/$IMAGE_NAME
# # Change all uppercase to lowercase
# IMAGE_ID=$(echo $IMAGE_ID | tr '[A-Z]' '[a-z]')
# # Strip git ref prefix from version
# VERSION=$(echo "${{ github.ref }}" | sed -e 's,.*/\(.*\),\1,')
# # Strip "v" prefix from tag name
# [[ "${{ github.ref }}" == "refs/tags/"* ]] && VERSION=$(echo $VERSION | sed -e 's/^v//')
# # Use Docker `latest` tag convention
# [ "$VERSION" == "$default-branch" ] && VERSION=latest
# echo IMAGE_ID=$IMAGE_ID
# echo VERSION=$VERSION
# docker tag $IMAGE_NAME $IMAGE_ID:$VERSION
# docker push $IMAGE_ID:$VERSION
# SHORT_SHA=$(echo ${GITHUB_SHA} | cut -c1-12)
# docker tag $IMAGE_NAME $IMAGE_ID:$SHORT_SHA
# docker push $IMAGE_ID:$SHORT_SHA
- name: Cleanup / Debug
# This job will run even on failures to help with debugging.
if: always()
run: |
echo "Report at final github action step:"
echo "Disk usage:"
pwd
du -hsc * | sort -hr
+115
View File
@@ -0,0 +1,115 @@
# Adapted from
# https://github.com/actions/starter-workflows/ci/docker-publish.yml
# If using base images, don't forget to add READ access, eg. from a package settings page like:
# https://github.com/orgs/storytold/packages/container/docker-base-images-rust-ssl/settings/actions_access
name: "[GPU] Build GHCR Docker artifact"
on:
push:
branches:
# NB: Default-branch doesn't work, despite Github's documentation.
#- $default-branch
- master
env:
IMAGE_NAME: storyteller-rust-gpu
jobs:
# Push image to GitHub Packages.
# See also https://docs.docker.com/docker-hub/builds/
# See also https://depot.dev/blog/docker-layer-caching-in-github-actions
# See also https://evilmartians.com/chronicles/build-images-on-github-actions-with-docker-layer-caching
build-docker-image:
name: "Build Docker Image"
#runs-on: ubuntu-22.04 # runs-on: ubuntu-latest
#runs-on: github-ubuntu-16core # NB: Premium GitHub runner with more cores
runs-on: github-ubuntu-64core # NB: Premium GitHub runner with more cores
if: github.event_name == 'push'
permissions:
packages: write
contents: read
steps:
- uses: actions/checkout@v3
# - uses: docker/setup-buildx-action@v1
# name: Set up Docker Buildx
- uses: docker/login-action@v1
name: Login to GitHub Container Registry
with:
registry: ghcr.io
username: ${{ github.actor }} # username: ${{ github.repository_owner }}
password: ${{ secrets.GITHUB_TOKEN }}
- name: Calculate short SHA
id: vars
# echo "sha_short=$(git rev-parse --short HEAD)" >> $GITHUB_OUTPUT
run: |
echo "sha_short=$(echo ${{ github.sha }} | cut -c1-12)" >> $GITHUB_OUTPUT
- name: Emit short SHA
run: |
echo "Full SHA: ${{ github.sha }}"
echo "Short SHA: ${{ steps.vars.outputs.sha_short }}"
#- uses: actions/cache@v2
# name: Cache Docker layers
# with:
# path: /tmp/.buildx-cache
# key: ${{ runner.os }}-buildx-${{ github.sha }}
# restore-keys: |
# ${{ runner.os }}-buildx-
# Docs for this action are at https://github.com/marketplace/actions/build-docker-images-using-cache
- uses: whoan/docker-build-with-cache-action@v6
with:
registry: ghcr.io
username: ${{ github.actor }} # username: ${{ github.repository_owner }}
password: ${{ secrets.GITHUB_TOKEN }}
image_name: storytold/storyteller-rust-gpu
dockerfile: service_gpu.Dockerfile
# NB: The `git_push_tag: true` option does not work as expected, so we put the sha in `image_tag`:
# https://github.com/whoan/docker-build-with-cache-action/issues/72
image_tag: latest,${{ github.sha }},${{ steps.vars.outputs.sha_short }}
# NB: Inject the Git SHA into the container so the servers can emit their own version:
build_extra_args: "--build-arg=GIT_SHA=${{ github.sha }}"
# - name: Build image
# run: |
# SHORT_SHA=$(echo ${GITHUB_SHA} | cut -c1-12)
# docker build . --file Dockerfile --tag $IMAGE_NAME --label "runnumber=${GITHUB_RUN_ID}" --build-arg GIT_SHA=${SHORT_SHA}
# - name: Push image to GitHub Container Registry
# run: |
# IMAGE_ID=ghcr.io/${{ github.repository_owner }}/$IMAGE_NAME
# # Change all uppercase to lowercase
# IMAGE_ID=$(echo $IMAGE_ID | tr '[A-Z]' '[a-z]')
# # Strip git ref prefix from version
# VERSION=$(echo "${{ github.ref }}" | sed -e 's,.*/\(.*\),\1,')
# # Strip "v" prefix from tag name
# [[ "${{ github.ref }}" == "refs/tags/"* ]] && VERSION=$(echo $VERSION | sed -e 's/^v//')
# # Use Docker `latest` tag convention
# [ "$VERSION" == "$default-branch" ] && VERSION=latest
# echo IMAGE_ID=$IMAGE_ID
# echo VERSION=$VERSION
# docker tag $IMAGE_NAME $IMAGE_ID:$VERSION
# docker push $IMAGE_ID:$VERSION
# SHORT_SHA=$(echo ${GITHUB_SHA} | cut -c1-12)
# docker tag $IMAGE_NAME $IMAGE_ID:$SHORT_SHA
# docker push $IMAGE_ID:$SHORT_SHA
- name: Cleanup / Debug
# This job will run even on failures to help with debugging.
if: always()
run: |
echo "Report at final github action step:"
echo "Disk usage:"
pwd
du -hsc * | sort -hr
+82
View File
@@ -0,0 +1,82 @@
# https://github.com/actions/starter-workflows/ci/docker-publish.yml
# If using base images, don't forget to add READ access, eg. from a package settings page like:
# https://github.com/orgs/storytold/packages/container/docker-base-images-rust-ssl/settings/actions_access
name: "Speedup Test"
on:
push:
branches:
- speedup-experiments
env:
IMAGE_NAME: storyteller-rust-speedup-exp
jobs:
# Push image to GitHub Packages.
# See also https://docs.docker.com/docker-hub/builds/
# See also https://depot.dev/blog/docker-layer-caching-in-github-actions
# See also https://evilmartians.com/chronicles/build-images-on-github-actions-with-docker-layer-caching
build-docker-image:
name: "Build Docker Image"
#runs-on: ubuntu-22.04 # runs-on: ubuntu-latest
#runs-on: github-ubuntu-16core # NB: Premium GitHub runner with more cores
runs-on: github-ubuntu-64core # NB: Premium GitHub runner with more cores
if: github.event_name == 'push'
permissions:
packages: write
contents: read
steps:
- uses: actions/checkout@v3
# - uses: docker/setup-buildx-action@v1
# name: Set up Docker Buildx
- uses: docker/login-action@v1
name: Login to GitHub Container Registry
with:
registry: ghcr.io
username: ${{ github.actor }} # username: ${{ github.repository_owner }}
password: ${{ secrets.GITHUB_TOKEN }}
- name: Calculate short SHA
id: vars
# echo "sha_short=$(git rev-parse --short HEAD)" >> $GITHUB_OUTPUT
run: |
echo "sha_short=$(echo ${{ github.sha }} | cut -c1-12)" >> $GITHUB_OUTPUT
- name: Emit short SHA
run: |
echo "Full SHA: ${{ github.sha }}"
echo "Short SHA: ${{ steps.vars.outputs.sha_short }}"
#- uses: actions/cache@v2
# name: Cache Docker layers
# with:
# path: /tmp/.buildx-cache
# key: ${{ runner.os }}-buildx-${{ github.sha }}
# restore-keys: |
# ${{ runner.os }}-buildx-
# Docs for this action are at https://github.com/marketplace/actions/build-docker-images-using-cache
- uses: whoan/docker-build-with-cache-action@v6
with:
registry: ghcr.io
username: ${{ github.actor }} # username: ${{ github.repository_owner }}
password: ${{ secrets.GITHUB_TOKEN }}
image_name: storytold/storyteller-rust-speedup-exp
dockerfile: service_cpu.Dockerfile
# NB: The `git_push_tag: true` option does not work as expected, so we put the sha in `image_tag`:
# https://github.com/whoan/docker-build-with-cache-action/issues/72
image_tag: speedup-${{ steps.vars.outputs.sha_short }}
# NB: Inject the Git SHA into the container so the servers can emit their own version:
build_extra_args: "--build-arg=GIT_SHA=${{ github.sha }}"
- name: Cleanup / Debug
# This job will run even on failures to help with debugging.
if: always()
run: |
echo "Report at final github action step:"
echo "Disk usage:"
pwd
du -hsc * | sort -hr
+52
View File
@@ -0,0 +1,52 @@
name: CI
on: [push, pull_request]
env:
MYSQL_URL: mysql://root:root@localhost/storyteller
DATABASE_URL: mysql://root:root@localhost/storyteller
REDIS_0_URL: redis://redisd@localhost/0
REDIS_1_URL: redis://redisd@localhost/1
DEBIAN_FRONTEND: noninteractive
jobs:
setup_build_test:
runs-on: ubuntu-20.04
steps:
- name: Checkout sources
uses: actions/checkout@v3
- name: Cache cargo registry
uses: actions/cache@v3
with:
path: |
~/.cargo/registry
~/.cargo/git
key: ${{ runner.os }}-cargo-${{ hashFiles('**/Cargo.toml') }}
- name: Setup mysql
run: |
sudo systemctl start mysql
sudo apt-get update
sudo apt-get -y install mysql-client libmysqlclient-dev
mysql -e "create user 'storyteller'@'localhost' IDENTIFIED BY 'password';" -uroot -proot
mysql -e "create database storyteller; grant all on storyteller.* to 'storyteller'@'localhost';" -uroot -proot
- name: Setup Redis
run: |
sudo apt-get -y install redis-server
sudo service redis-server start
- name: Setup Rust
run: |
rustup set profile minimal
rustup show
rustup install 1.66
rustup default 1.66
rustup show
cargo install sqlx-cli --features openssl-vendored
cargo install diesel_cli
- name: Run database migrations
run: |
# nothing to see here ;)
set +e +o pipefail
diesel migration run
set -e -o pipefail
- name: Build
run: cargo build --release
- name: Test
run: cargo test --release
+5 -51
View File
@@ -2,64 +2,29 @@
*secret*sh
.env
.env-aichatbot-secrets
.env-analytics-job
.env-elasticsearch-secrets
.env-migration-tool-secrets
.env-secrets
.env-support-tool-secrets
_develop/tools/.secrets
_develop/tools/db_secrets.toml
crates/service/web/storyteller_web/config/storyteller-web.development-secrets.env
db.secrets
db_secrets.toml
env-secrets
pubkeys.txt
secrets.toml
secrets.yaml
secrets/
twitch_secrets.toml
# Old env secrets
.*-secrets
# New env secrets (per-app)
*-secrets.env
# Utilities with secrets
production_database_secret_connect.sh
production_database_secret_query.sh
production_database_voice_clone_report_download.sh
script/artcraft/mac_signing_build.sh
script/production_database_secret_backup.sh
script/production_database_secret_connect.sh
script/socat_dev_database_connect.sh
secrets.toml
secrets.yaml
twitch_secrets.toml
# Python virtual envs (named by convention)
venv/
# LLM Testing
/external/
/prompts/
/reports/
/requests/
# Scratch data
scratch/
test_data/temp/
untracked/
tmp/
# New env secrets (per-app)
*-secrets.env
# Rust build directory
target/
crates/lib/database_queries/target/
crates/lib/sqlite_queries/target/
# Javascript build directories
node_modules/
# Frontend build outputs
frontend/apps/artcraft/bundle-report.html
# Vim noise
*.swo
*.swp
@@ -74,9 +39,6 @@ __pycache__/
# We use diesel for DB migrations only. We don't care about its codgen.
_ignored_schema.rs
# Diesel lock file
.diesel_lock
# AI Chat Sidecar has its own schema managed by diesel, but we don't care for diesel codegen.
crates/programs/aichatbot-sidecar/_ignored_schema.rs
@@ -93,15 +55,7 @@ models/tacotron2/python/
# Stuff I want to keep around, but not commit
scraps/
# Mac nonsense
.DS_Store
# Windows build files
# These should be built by the platform
windows/sqlite/sqlite3.exp
windows/sqlite/sqlite3.lib
# ArtCraft Windows DLLs
crates/desktop/src-tauri/*.dll
windows_dlls/
+53
View File
@@ -0,0 +1,53 @@
<component name="ProjectDictionaryState">
<dictionary name="bt">
<words>
<w>arpabet</w>
<w>backfill</w>
<w>canonicalized</w>
<w>canonicalizing</w>
<w>cashapp</w>
<w>cheermote</w>
<w>cidrs</w>
<w>crockford</w>
<w>culted</w>
<w>dalle</w>
<w>demuxer</w>
<w>dereferencing</w>
<w>downloaders</w>
<w>downvote</w>
<w>encodec</w>
<w>fakeyou</w>
<w>ffprobe</w>
<w>greenlight</w>
<w>greenlighting</w>
<w>greenlit</w>
<w>hanashi</w>
<w>hifigan</w>
<w>hparams</w>
<w>huggingface</w>
<w>lipsync</w>
<w>mochi</w>
<w>nestedness</w>
<w>pathbuf</w>
<w>replayable</w>
<w>retryably</w>
<w>scrollback</w>
<w>softvc</w>
<w>spammy</w>
<w>sql's</w>
<w>symphonia</w>
<w>tacotron</w>
<w>techcrunch</w>
<w>transcoded</w>
<w>transcodings</w>
<w>unpermitted</w>
<w>upserting</w>
<w>vits</w>
<w>vocoded</w>
<w>vocoder</w>
<w>vocoders</w>
<w>vocodes</w>
<w>waveglow</w>
</words>
</dictionary>
</component>
@@ -0,0 +1,289 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n w2l.token as template_token,\n w2l.template_type,\n w2l.creator_user_token,\n users.is_banned as creator_is_banned,\n users.username as creator_username,\n users.display_name as creator_display_name,\n users.email_gravatar_hash as creator_gravatar_hash,\n w2l.title,\n w2l.description_markdown,\n w2l.description_rendered_html,\n w2l.frame_width,\n w2l.frame_height,\n w2l.duration_millis,\n w2l.maybe_public_bucket_preview_image_object_name,\n w2l.maybe_public_bucket_preview_video_object_name,\n w2l.creator_set_visibility,\n w2l.is_public_listing_approved,\n w2l.is_locked_from_use,\n w2l.is_locked_from_user_modification,\n w2l.creator_ip_address_creation,\n w2l.creator_ip_address_last_update,\n w2l.created_at,\n w2l.updated_at,\n w2l.user_deleted_at,\n w2l.mod_deleted_at\nFROM w2l_templates as w2l\nJOIN users\n ON users.token = w2l.creator_user_token\nWHERE w2l.token = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "template_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "template_type",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 2,
"name": "creator_user_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 3,
"name": "creator_is_banned",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 4,
"name": "creator_username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 5,
"name": "creator_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 6,
"name": "creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 7,
"name": "title",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 8,
"name": "description_markdown",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 9,
"name": "description_rendered_html",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 10,
"name": "frame_width",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 11,
"name": "frame_height",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 12,
"name": "duration_millis",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 13,
"name": "maybe_public_bucket_preview_image_object_name",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 14,
"name": "maybe_public_bucket_preview_video_object_name",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 15,
"name": "creator_set_visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 16,
"name": "is_public_listing_approved",
"type_info": {
"type": "Tiny",
"flags": "MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 17,
"name": "is_locked_from_use",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 18,
"name": "is_locked_from_user_modification",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 19,
"name": "creator_ip_address_creation",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 20,
"name": "creator_ip_address_last_update",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 21,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 22,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 23,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 24,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
true,
true,
false,
true,
false,
false,
false,
false,
false,
false,
true,
true
]
},
"hash": "0033c76be0ea1c99069f1a8df1ce400c7064526feaf5dc88930da0718a885b19"
}
@@ -0,0 +1,432 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n tts.token as model_token,\n tts.tts_model_type as `tts_model_type: enums::by_table::tts_models::tts_model_type::TtsModelType`,\n tts.text_pipeline_type,\n tts.text_preprocessing_algorithm,\n tts.maybe_default_pretrained_vocoder,\n\n tts.use_default_mel_multiply_factor,\n tts.maybe_custom_mel_multiply_factor,\n\n tts.creator_user_token,\n users.username as creator_username,\n users.display_name as creator_display_name,\n users.email_gravatar_hash as creator_gravatar_hash,\n users.is_banned as creator_is_banned,\n\n tts.title,\n tts.description_markdown,\n tts.description_rendered_html,\n\n tts.ietf_language_tag,\n tts.ietf_primary_language_subtag,\n\n tts.is_front_page_featured,\n tts.is_twitch_featured,\n\n tts.maybe_suggested_unique_bot_command,\n\n tts.user_ratings_positive_count,\n tts.user_ratings_negative_count,\n tts.user_ratings_total_count,\n\n tts.creator_set_visibility,\n\n tts.is_locked_from_use,\n tts.is_locked_from_user_modification,\n\n tts.maybe_custom_vocoder_token,\n vocoder.title as maybe_custom_vocoder_title,\n vocoder_user.token as maybe_custom_vocoder_creator_user_token,\n vocoder_user.username as maybe_custom_vocoder_creator_username,\n vocoder_user.display_name as maybe_custom_vocoder_creator_display_name,\n vocoder_user.email_gravatar_hash as maybe_custom_vocoder_creator_gravatar_hash,\n\n tts.created_at,\n tts.updated_at,\n\n tts.creator_ip_address_creation,\n tts.creator_ip_address_last_update,\n tts.mod_deleted_at,\n tts.user_deleted_at\n\nFROM tts_models as tts\nJOIN users\n ON users.token = tts.creator_user_token\n\nLEFT OUTER JOIN vocoder_models AS vocoder\n ON vocoder.token = tts.maybe_custom_vocoder_token\nLEFT OUTER JOIN users AS vocoder_user\n ON vocoder_user.token = vocoder.creator_user_token\n\nWHERE\n tts.token = ?\n AND tts.user_deleted_at IS NULL\n AND tts.mod_deleted_at IS NULL\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "model_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "tts_model_type: enums::by_table::tts_models::tts_model_type::TtsModelType",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 60
}
},
{
"ordinal": 2,
"name": "text_pipeline_type",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 3,
"name": "text_preprocessing_algorithm",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 4,
"name": "maybe_default_pretrained_vocoder",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 5,
"name": "use_default_mel_multiply_factor",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 6,
"name": "maybe_custom_mel_multiply_factor",
"type_info": {
"type": "Double",
"flags": "",
"char_set": 63,
"max_size": 22
}
},
{
"ordinal": 7,
"name": "creator_user_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 8,
"name": "creator_username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 9,
"name": "creator_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 10,
"name": "creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 11,
"name": "creator_is_banned",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 12,
"name": "title",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 13,
"name": "description_markdown",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 14,
"name": "description_rendered_html",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 15,
"name": "ietf_language_tag",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 16,
"name": "ietf_primary_language_subtag",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY",
"char_set": 224,
"max_size": 48
}
},
{
"ordinal": 17,
"name": "is_front_page_featured",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 18,
"name": "is_twitch_featured",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 19,
"name": "maybe_suggested_unique_bot_command",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 20,
"name": "user_ratings_positive_count",
"type_info": {
"type": "Long",
"flags": "NOT_NULL | UNSIGNED",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 21,
"name": "user_ratings_negative_count",
"type_info": {
"type": "Long",
"flags": "NOT_NULL | UNSIGNED",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 22,
"name": "user_ratings_total_count",
"type_info": {
"type": "Long",
"flags": "NOT_NULL | UNSIGNED",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 23,
"name": "creator_set_visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 24,
"name": "is_locked_from_use",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 25,
"name": "is_locked_from_user_modification",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 26,
"name": "maybe_custom_vocoder_token",
"type_info": {
"type": "VarString",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 27,
"name": "maybe_custom_vocoder_title",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 28,
"name": "maybe_custom_vocoder_creator_user_token",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 29,
"name": "maybe_custom_vocoder_creator_username",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 30,
"name": "maybe_custom_vocoder_creator_display_name",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 31,
"name": "maybe_custom_vocoder_creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 32,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 33,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 34,
"name": "creator_ip_address_creation",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 35,
"name": "creator_ip_address_last_update",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 36,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 37,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
true,
false,
true,
false,
true,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
true,
false,
false,
false,
false,
false,
false,
true,
true,
true,
true,
true,
true,
false,
false,
false,
false,
true,
true
]
},
"hash": "0049a4b3dd3770564c3a466ade7479f0a11508bd4a48b2344b28ff0a20e0b9ca"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE api_tokens\nSET\n deleted_at = CURRENT_TIMESTAMP,\n ip_address_last_update = ?\nWHERE\n user_token = ?\n AND api_token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "01f91b5f3c3357aa3397102f52524b4221124caecda2a62f4a4bb31855547b68"
}
@@ -0,0 +1,36 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n id,\n status\nFROM w2l_inference_jobs\nWHERE id = ?\nFOR UPDATE\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "id",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL | PRIMARY_KEY | AUTO_INCREMENT",
"char_set": 63,
"max_size": 20
}
},
{
"ordinal": 1,
"name": "status",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 64
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false
]
},
"hash": "02060ab9b8ca472a2bd4d4fa3120743e90148ccd6a4cb13bc491d00f36ed7a8f"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO media_files\nSET\n token = ?,\n\n origin_category = ?,\n origin_product_category = ?,\n\n media_type = ?,\n maybe_mime_type = ?,\n file_size_bytes = ?,\n checksum_sha2 = ?,\n\n public_bucket_directory_hash = ?,\n maybe_public_bucket_prefix = ?,\n maybe_public_bucket_extension = ?,\n\n maybe_creator_user_token = ?,\n creator_ip_address = ?,\n\n creator_set_visibility = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 13
},
"nullable": []
},
"hash": "030e26fa7977555cdd04864d9b95c07196ab520cd8c63d30689b6021fa4b4ec1"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE comments\nSET\n mod_deleted_at = CURRENT_TIMESTAMP,\n version = version + 1\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 1
},
"nullable": []
},
"hash": "044b4a53b537fdc154f049488e222ac001b04cf0f47df6ac79f2b0d8f79b5aff"
}
@@ -0,0 +1,113 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n vc.token as `token: tokens::tokens::voice_conversion_models::VoiceConversionModelToken`,\n vc.model_type as `model_type: enums::by_table::voice_conversion_models::voice_conversion_model_type::VoiceConversionModelType`,\n\n vc.title,\n vc.has_index_file,\n vc.private_bucket_hash,\n\n vc.created_at,\n vc.updated_at,\n vc.user_deleted_at,\n vc.mod_deleted_at\n\nFROM voice_conversion_models as vc\n\nWHERE vc.token = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "token: tokens::tokens::voice_conversion_models::VoiceConversionModelToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "model_type: enums::by_table::voice_conversion_models::voice_conversion_model_type::VoiceConversionModelType",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 2,
"name": "title",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 3,
"name": "has_index_file",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 4,
"name": "private_bucket_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 5,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 6,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 7,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 8,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
false,
false,
false,
true,
true
]
},
"hash": "05829f0117166608489ceb409d9bfd3cb3c71e58f29202e53a5a4372c0575dec"
}
@@ -0,0 +1,168 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n w2l.token as template_token,\n w2l.template_type,\n w2l.creator_user_token,\n users.username as creator_username,\n users.display_name as creator_display_name,\n w2l.title,\n w2l.frame_width,\n w2l.frame_height,\n w2l.duration_millis,\n w2l.maybe_public_bucket_preview_image_object_name,\n w2l.maybe_public_bucket_preview_video_object_name,\n w2l.is_public_listing_approved,\n w2l.created_at,\n w2l.updated_at\nFROM w2l_templates as w2l\nJOIN users\nON\n users.token = w2l.creator_user_token\nWHERE\n users.username = ?\n AND w2l.user_deleted_at IS NULL\n AND w2l.mod_deleted_at IS NULL\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "template_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "template_type",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 2,
"name": "creator_user_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 3,
"name": "creator_username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 4,
"name": "creator_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 5,
"name": "title",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 6,
"name": "frame_width",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 7,
"name": "frame_height",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 8,
"name": "duration_millis",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 9,
"name": "maybe_public_bucket_preview_image_object_name",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 10,
"name": "maybe_public_bucket_preview_video_object_name",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 11,
"name": "is_public_listing_approved",
"type_info": {
"type": "Tiny",
"flags": "MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 12,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 13,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
false,
false,
false,
false,
false,
true,
true,
true,
false,
false
]
},
"hash": "05c3ebf54cd8a5374d6f4bbe21b3c6027ce6314917af8acd0ed136d375d53342"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE users\nSET\n email_confirmed = true,\n password_hash = ?,\n ip_address_last_update = ?,\n password_version = password_version + 1,\n version = version + 1\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "05de463f1c408793d64fb011b1732e3c1b3cf485076b3e1a4a50d16683b99e46"
}
@@ -0,0 +1,190 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n id,\n token,\n uuid_idempotency_token,\n on_success_result_token,\n creator_user_token as `creator_user_token: tokens::tokens::users::UserToken`,\n creator_ip_address,\n creator_set_visibility,\n title,\n tts_model_type,\n download_url,\n status,\n attempt_count,\n failure_reason,\n created_at,\n updated_at,\n retry_at\nFROM tts_model_upload_jobs\nWHERE\n (\n status IN (\"pending\", \"attempt_failed\")\n )\n AND\n (\n retry_at IS NULL\n OR\n retry_at < CURRENT_TIMESTAMP\n )\n LIMIT ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "id",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL | PRIMARY_KEY | AUTO_INCREMENT",
"char_set": 63,
"max_size": 20
}
},
{
"ordinal": 1,
"name": "token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 2,
"name": "uuid_idempotency_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 144
}
},
{
"ordinal": 3,
"name": "on_success_result_token",
"type_info": {
"type": "VarString",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 4,
"name": "creator_user_token: tokens::tokens::users::UserToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 5,
"name": "creator_ip_address",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 6,
"name": "creator_set_visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 7,
"name": "title",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 8,
"name": "tts_model_type",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 60
}
},
{
"ordinal": 9,
"name": "download_url",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 2048
}
},
{
"ordinal": 10,
"name": "status",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 11,
"name": "attempt_count",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 3
}
},
{
"ordinal": 12,
"name": "failure_reason",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 2048
}
},
{
"ordinal": 13,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 14,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 15,
"name": "retry_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
true,
false,
false,
false,
false,
false,
true,
false,
false,
true,
false,
false,
true
]
},
"hash": "066c16a04112b0ee83a54e29d5f96125f7c90db89ec9bd16275172d14722a381"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO media_uploads\nSET\n token = ?,\n uuid_idempotency_token = ?,\n\n media_type = ?,\n media_source = ?,\n\n maybe_original_filename = ?,\n original_file_size_bytes = ?,\n original_duration_millis = ?,\n maybe_original_mime_type = ?,\n maybe_original_audio_encoding = ?,\n maybe_original_video_encoding = ?,\n maybe_original_frame_width = ?,\n maybe_original_frame_height = ?,\n checksum_sha2 = ?,\n\n public_bucket_directory_hash = ?,\n\n maybe_extra_file_modification_info = ?,\n\n maybe_creator_user_token = ?,\n maybe_creator_synthetic_id = ?,\n maybe_creator_anonymous_visitor_token = ?,\n creator_ip_address = ?,\n creator_set_visibility = ?\n\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 20
},
"nullable": []
},
"hash": "06de93ce575c8baf2159eef2a965c18ead4c589bfaeced6e4757af79f46c89e3"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO audit_logs\nSET\n token = ?,\n entity_type = ?,\n entity_token = ?,\n entity_action = ?,\n maybe_actor_user_token = ?,\n maybe_actor_anonymous_visitor_token = '',\n is_actor_moderator = ?,\n actor_ip_address = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 7
},
"nullable": []
},
"hash": "07063c214be251d3fb890393ee5b322e7947dfca7115a61ec75777f6a344e835"
}
@@ -0,0 +1,47 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n maybe_model_type as queue_type,\n count(*) as pending_job_count,\n NOW() as present_time\n FROM (\n SELECT\n token,\n maybe_model_type\n FROM generic_inference_jobs\n WHERE status IN (\"pending\", \"attempt_failed\")\n AND maybe_model_type IS NOT NULL\n UNION\n SELECT\n token,\n maybe_model_type\n FROM generic_inference_jobs\n WHERE status IN (\"started\")\n AND created_at > (CURDATE() - INTERVAL 15 MINUTE)\n AND maybe_model_type IS NOT NULL\n) as generic_inner\nGROUP BY queue_type\nUNION\nSELECT\n \"legacy_tts\" as queue_type,\n count(*) as pending_job_count,\n NOW() as present_time\nFROM (\n SELECT\n token\n FROM tts_inference_jobs\n WHERE status IN (\"pending\", \"attempt_failed\")\n UNION\n SELECT\n token\n FROM tts_inference_jobs\n WHERE status IN (\"started\")\n AND created_at > (CURDATE() - INTERVAL 15 MINUTE)\n) as legacy_inner\nGROUP BY queue_type\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "queue_type",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "pending_job_count",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL | BINARY",
"char_set": 63,
"max_size": 21
}
},
{
"ordinal": 2,
"name": "present_time",
"type_info": {
"type": "Datetime",
"flags": "NOT_NULL",
"char_set": 224,
"max_size": 76
}
}
],
"parameters": {
"Right": 0
},
"nullable": [
true,
false,
false
]
},
"hash": "074307d7cd5c9a6f27e4d5ecce3072dcd13914a6f7f5f27f0f7232ae6c4813b4"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO unsubscribe_reason \nSET \n user_token = ?,\n feedback_reason = ?,\n ip_address = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "079ea2dd582d061db2e824833bf47e60523aed758aefb6a317f29611b8344ab8"
}
@@ -0,0 +1,388 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n users.token as user_token,\n users.username,\n users.display_name,\n\n users.email_address,\n users.email_confirmed,\n users.email_gravatar_hash,\n\n users.maybe_stripe_customer_id,\n users.maybe_loyalty_program_key,\n\n users.disable_gravatar,\n users.auto_play_audio_preference,\n users.auto_play_video_preference,\n users.preferred_tts_result_visibility as `preferred_tts_result_visibility: enums::common::visibility::Visibility`,\n users.preferred_w2l_result_visibility as `preferred_w2l_result_visibility: enums::common::visibility::Visibility`,\n\n users.user_role_slug,\n users.is_banned,\n\n user_roles.can_use_tts,\n user_roles.can_use_w2l,\n user_roles.can_delete_own_tts_results,\n user_roles.can_delete_own_w2l_results,\n user_roles.can_delete_own_account,\n\n user_roles.can_upload_tts_models,\n user_roles.can_upload_w2l_templates,\n user_roles.can_delete_own_tts_models,\n user_roles.can_delete_own_w2l_templates,\n\n user_roles.can_approve_w2l_templates,\n user_roles.can_edit_other_users_profiles,\n user_roles.can_edit_other_users_tts_models,\n user_roles.can_edit_other_users_w2l_templates,\n user_roles.can_delete_other_users_tts_models,\n user_roles.can_delete_other_users_tts_results,\n user_roles.can_delete_other_users_w2l_templates,\n user_roles.can_delete_other_users_w2l_results,\n user_roles.can_ban_users,\n user_roles.can_delete_users\n\nFROM users\nLEFT OUTER JOIN user_sessions\n ON users.token = user_sessions.user_token\nLEFT OUTER JOIN user_roles\n ON users.user_role_slug = user_roles.slug\nWHERE user_sessions.token = ?\n AND user_sessions.deleted_at IS NULL\n AND users.user_deleted_at IS NULL\n AND users.mod_deleted_at IS NULL\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "user_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 2,
"name": "display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 3,
"name": "email_address",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 4,
"name": "email_confirmed",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 5,
"name": "email_gravatar_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 6,
"name": "maybe_stripe_customer_id",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 7,
"name": "maybe_loyalty_program_key",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 8,
"name": "disable_gravatar",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 9,
"name": "auto_play_audio_preference",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 10,
"name": "auto_play_video_preference",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 11,
"name": "preferred_tts_result_visibility: enums::common::visibility::Visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 12,
"name": "preferred_w2l_result_visibility: enums::common::visibility::Visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 13,
"name": "user_role_slug",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 14,
"name": "is_banned",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 15,
"name": "can_use_tts",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 16,
"name": "can_use_w2l",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 17,
"name": "can_delete_own_tts_results",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 18,
"name": "can_delete_own_w2l_results",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 19,
"name": "can_delete_own_account",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 20,
"name": "can_upload_tts_models",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 21,
"name": "can_upload_w2l_templates",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 22,
"name": "can_delete_own_tts_models",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 23,
"name": "can_delete_own_w2l_templates",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 24,
"name": "can_approve_w2l_templates",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 25,
"name": "can_edit_other_users_profiles",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 26,
"name": "can_edit_other_users_tts_models",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 27,
"name": "can_edit_other_users_w2l_templates",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 28,
"name": "can_delete_other_users_tts_models",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 29,
"name": "can_delete_other_users_tts_results",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 30,
"name": "can_delete_other_users_w2l_templates",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 31,
"name": "can_delete_other_users_w2l_results",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 32,
"name": "can_ban_users",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 33,
"name": "can_delete_users",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
false,
false,
true,
true,
false,
true,
true,
false,
false,
false,
false,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true
]
},
"hash": "07d330b4c2e6b0dc76e2e61a3b44b47b8d287adf5eb0646f6cf2876655581a13"
}
@@ -0,0 +1,113 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n voice_conversion_results.token as `voice_conversion_result_token: tokens::tokens::voice_conversion_results::VoiceConversionResultToken`,\n\n users.token as `maybe_creator_user_token: tokens::tokens::users::UserToken`,\n users.is_banned as maybe_creator_is_banned,\n\n voice_conversion_results.public_bucket_hash,\n\n voice_conversion_results.creator_set_visibility,\n\n voice_conversion_results.file_size_bytes,\n voice_conversion_results.duration_millis,\n\n voice_conversion_results.user_deleted_at,\n voice_conversion_results.mod_deleted_at\n\nFROM voice_conversion_results\nLEFT OUTER JOIN voice_conversion_models\n ON voice_conversion_results.model_token = voice_conversion_models.token\nLEFT OUTER JOIN users\n ON voice_conversion_results.maybe_creator_user_token = users.token\nWHERE\n voice_conversion_results.token = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "voice_conversion_result_token: tokens::tokens::voice_conversion_results::VoiceConversionResultToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "maybe_creator_user_token: tokens::tokens::users::UserToken",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 2,
"name": "maybe_creator_is_banned",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 3,
"name": "public_bucket_hash",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 4,
"name": "creator_set_visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 5,
"name": "file_size_bytes",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 6,
"name": "duration_millis",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 7,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 8,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
true,
true,
false,
false,
false,
false,
true,
true
]
},
"hash": "080bd6e83a5a783ce5da4a254f3bbe67991eb0f045c990a586c48b64ef46ab3d"
}
@@ -0,0 +1,289 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n w2l.token as template_token,\n w2l.template_type,\n w2l.creator_user_token,\n users.is_banned as creator_is_banned,\n users.username as creator_username,\n users.display_name as creator_display_name,\n users.email_gravatar_hash as creator_gravatar_hash,\n w2l.title,\n w2l.description_markdown,\n w2l.description_rendered_html,\n w2l.frame_width,\n w2l.frame_height,\n w2l.duration_millis,\n w2l.maybe_public_bucket_preview_image_object_name,\n w2l.maybe_public_bucket_preview_video_object_name,\n w2l.creator_set_visibility,\n w2l.is_public_listing_approved,\n w2l.is_locked_from_use,\n w2l.is_locked_from_user_modification,\n w2l.creator_ip_address_creation,\n w2l.creator_ip_address_last_update,\n w2l.created_at,\n w2l.updated_at,\n w2l.user_deleted_at,\n w2l.mod_deleted_at\nFROM w2l_templates as w2l\nJOIN users\n ON users.token = w2l.creator_user_token\nWHERE\n w2l.token = ?\n AND w2l.user_deleted_at IS NULL\n AND w2l.mod_deleted_at IS NULL\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "template_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "template_type",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 2,
"name": "creator_user_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 3,
"name": "creator_is_banned",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 4,
"name": "creator_username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 5,
"name": "creator_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 6,
"name": "creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 7,
"name": "title",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 8,
"name": "description_markdown",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 9,
"name": "description_rendered_html",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 10,
"name": "frame_width",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 11,
"name": "frame_height",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 12,
"name": "duration_millis",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 13,
"name": "maybe_public_bucket_preview_image_object_name",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 14,
"name": "maybe_public_bucket_preview_video_object_name",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 15,
"name": "creator_set_visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 16,
"name": "is_public_listing_approved",
"type_info": {
"type": "Tiny",
"flags": "MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 17,
"name": "is_locked_from_use",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 18,
"name": "is_locked_from_user_modification",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 19,
"name": "creator_ip_address_creation",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 20,
"name": "creator_ip_address_last_update",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 21,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 22,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 23,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 24,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
true,
true,
false,
true,
false,
false,
false,
false,
false,
false,
true,
true
]
},
"hash": "089986414149d2d189f4262f8aa7488d35f6a162a4e56f06c1b897092d37ea20"
}
@@ -0,0 +1,25 @@
{
"db_name": "MySQL",
"query": "\nSELECT count(*) as count\nFROM tts_models\nWHERE\n creator_user_token = ?\nLIMIT 1\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "count",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL | BINARY",
"char_set": 63,
"max_size": 21
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false
]
},
"hash": "09e655ea4b3504cbb3bc18b92c6c25861c941ba073e3aead414e560b05bd7638"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE zs_voices\nSET\n mod_deleted_at = NULL,\n maybe_mod_user_token = ?\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "0a913be3a4bee4f1c3ed9e830c8b32da6d35c5f5917d76a7d923b622469b6e51"
}
@@ -0,0 +1,113 @@
{
"db_name": "MySQL",
"query": "\n SELECT\n zds.token as `token: tokens::tokens::zs_voice_dataset_samples::ZsVoiceDatasetSampleToken`,\n zds.media_file_token as `media_file_token: tokens::tokens::media_files::MediaFileToken`,\n m.media_type as `media_type: enums::by_table::media_files::media_file_type::MediaFileType`,\n m.public_bucket_directory_hash,\n m.maybe_public_bucket_prefix,\n m.maybe_public_bucket_extension,\n zds.maybe_creator_user_token as `maybe_creator_user_token: tokens::tokens::users::UserToken`,\n zds.created_at,\n zds.updated_at\n FROM zs_voice_dataset_samples as zds\n JOIN media_files as m\n ON zds.media_file_token = m.token\n WHERE zds.dataset_token = ?\n AND zds.user_deleted_at IS NULL\n AND zds.mod_deleted_at IS NULL\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "token: tokens::tokens::zs_voice_dataset_samples::ZsVoiceDatasetSampleToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "media_file_token: tokens::tokens::media_files::MediaFileToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 2,
"name": "media_type: enums::by_table::media_files::media_file_type::MediaFileType",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 3,
"name": "public_bucket_directory_hash",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 4,
"name": "maybe_public_bucket_prefix",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 5,
"name": "maybe_public_bucket_extension",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 6,
"name": "maybe_creator_user_token: tokens::tokens::users::UserToken",
"type_info": {
"type": "VarString",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 7,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 8,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
true,
true,
true,
false,
false
]
},
"hash": "0cad9a0df1167ae1dfb7847b5ab8a09a7b1e1f7bf0d7a06beddab1098cb285f6"
}
@@ -0,0 +1,36 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n id,\n status\nFROM tts_model_upload_jobs\nWHERE id = ?\nFOR UPDATE\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "id",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL | PRIMARY_KEY | AUTO_INCREMENT",
"char_set": 63,
"max_size": 20
}
},
{
"ordinal": 1,
"name": "status",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 64
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false
]
},
"hash": "0caed749627ff22ae1cea52621a375156259a731e8070459593082b80d463491"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO generic_inference_jobs\nSET\n token = ?,\n uuid_idempotency_token = ?,\n\n inference_category = ?,\n maybe_model_type = ?,\n maybe_model_token = ?,\n\n maybe_input_source_token = ?,\n maybe_input_source_token_type = ?,\n\n maybe_raw_inference_text = ?,\n\n maybe_inference_args = ?,\n\n maybe_creator_user_token = ?,\n maybe_creator_anonymous_visitor_token = ?,\n creator_ip_address = ?,\n\n creator_set_visibility = ?,\n\n priority_level = ?,\n is_keepalive_required = ?,\n max_duration_seconds = ?,\n\n is_debug_request = ?,\n maybe_routing_tag = ?,\n\n status = \"pending\"\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 18
},
"nullable": []
},
"hash": "0d780caac7560f84efb50bd2ed876cbdd728b32e26b73dfbb3009ada12985405"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO tts_inference_jobs\nSET\n token = ?,\n uuid_idempotency_token = ?,\n model_token = ?,\n raw_inference_text = ?,\n maybe_creator_user_token = ?,\n creator_ip_address = ?,\n creator_set_visibility = ?,\n is_from_api = ?,\n is_for_twitch = ?,\n is_debug_request = ?,\n priority_level = ?,\n max_duration_seconds = ?,\n status = \"pending\"\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 12
},
"nullable": []
},
"hash": "0ee578c7a7be5c818c85178a2992c7978165b2659ccbb0996c8a809bef827037"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE tts_results\nSET\n creator_set_visibility = ?,\n maybe_mod_user_token = ?\nWHERE token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "0ff13b84956c2625050211a5bb2352a489ef8435571c364c8b2d1d21d936cbd4"
}
@@ -0,0 +1,69 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n badges.slug,\n badges.title,\n badges.description,\n badges.image_url,\n user_badges.created_at as user_created_at\n\nFROM badges\nJOIN user_badges\nON\n badges.slug = user_badges.badge_slug\nWHERE\n user_badges.user_token = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "slug",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "title",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 2,
"name": "description",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 2048
}
},
{
"ordinal": 3,
"name": "image_url",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 2048
}
},
{
"ordinal": 4,
"name": "user_created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
false
]
},
"hash": "10d93ef1350115742d8dddb951f98dfebabf7df3e44577b97b52343f0650eba1"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO email_sender_jobs\nSET\n token = ?,\n uuid_idempotency_token = ?,\n\n destination_email_address = ?,\n maybe_destination_user_token = ?,\n\n email_category = ?,\n maybe_email_args = ?,\n\n ietf_language_tag = ?,\n ietf_primary_language_subtag = ?,\n\n maybe_creator_user_token = ?,\n maybe_creator_anonymous_visitor_token = ?,\n maybe_creator_ip_address = ?,\n\n priority_level = ?,\n\n is_debug_request = ?,\n maybe_routing_tag = ?,\n\n status = \"pending\"\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 14
},
"nullable": []
},
"hash": "112a5ce6412c7ab9995bab3906f3ddd4b74068346a3e188f669c146e4ff1ac12"
}
@@ -0,0 +1,25 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n next_id\nFROM\n w2l_result_synthetic_ids\nWHERE\n user_token = ?\nLIMIT 1\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "next_id",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 20
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false
]
},
"hash": "1236640a30d0d5177e13c31b61b791874f7c70026003a58ba6e07e7af46c30c1"
}
@@ -0,0 +1,311 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n tts_results.token as tts_result_token,\n\n tts_results.raw_inference_text,\n\n tts_results.model_token as tts_model_token,\n tts_models.title as tts_model_title,\n\n tts_results.maybe_pretrained_vocoder_used,\n\n users.token as `maybe_creator_user_token: tokens::tokens::users::UserToken`,\n users.username as maybe_creator_username,\n users.display_name as maybe_creator_display_name,\n users.email_gravatar_hash as maybe_creator_gravatar_hash,\n users.is_banned as maybe_creator_is_banned,\n\n model_users.token as maybe_model_creator_user_token,\n model_users.username as maybe_model_creator_username,\n model_users.display_name as maybe_model_creator_display_name,\n model_users.email_gravatar_hash as maybe_model_creator_gravatar_hash,\n model_users.is_banned as maybe_model_creator_is_banned,\n\n tts_results.public_bucket_wav_audio_path,\n tts_results.public_bucket_spectrogram_path,\n\n tts_results.creator_set_visibility,\n\n tts_results.generated_by_worker,\n tts_results.is_debug_request,\n\n tts_results.file_size_bytes,\n tts_results.duration_millis,\n tts_results.created_at,\n tts_results.updated_at,\n\n tts_results.creator_ip_address,\n tts_results.user_deleted_at,\n tts_results.mod_deleted_at\n\nFROM tts_results\nLEFT OUTER JOIN tts_models\n ON tts_results.model_token = tts_models.token\nLEFT OUTER JOIN users\n ON tts_results.maybe_creator_user_token = users.token\nLEFT OUTER JOIN users as model_users\n ON tts_models.creator_user_token = model_users.token\nWHERE\n tts_results.token = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "tts_result_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "raw_inference_text",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 2,
"name": "tts_model_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 3,
"name": "tts_model_title",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 4,
"name": "maybe_pretrained_vocoder_used",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 5,
"name": "maybe_creator_user_token: tokens::tokens::users::UserToken",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 6,
"name": "maybe_creator_username",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 7,
"name": "maybe_creator_display_name",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 8,
"name": "maybe_creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 9,
"name": "maybe_creator_is_banned",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 10,
"name": "maybe_model_creator_user_token",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 11,
"name": "maybe_model_creator_username",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 12,
"name": "maybe_model_creator_display_name",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 13,
"name": "maybe_model_creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 14,
"name": "maybe_model_creator_is_banned",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 15,
"name": "public_bucket_wav_audio_path",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 16,
"name": "public_bucket_spectrogram_path",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 17,
"name": "creator_set_visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 18,
"name": "generated_by_worker",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 19,
"name": "is_debug_request",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 20,
"name": "file_size_bytes",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 21,
"name": "duration_millis",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 22,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 23,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 24,
"name": "creator_ip_address",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 25,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 26,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
false,
false,
false,
true,
false,
false,
false,
false,
false,
false,
true,
true
]
},
"hash": "1246d346e63efa99516ab4efa2aec90e37322184237d94782f77cf7a7a14d53f"
}
@@ -0,0 +1,36 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n assignments.model_token AS tts_model_token,\n assignments.category_token\nFROM\n tts_category_assignments AS assignments\nJOIN\n tts_models AS tts\n ON assignments.model_token = tts.token\nWHERE\n tts.is_locked_from_use IS FALSE\n AND tts.user_deleted_at IS NULL\n AND tts.mod_deleted_at IS NULL\n AND assignments.deleted_at IS NULL\n\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "tts_model_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "category_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
}
],
"parameters": {
"Right": 0
},
"nullable": [
false,
false
]
},
"hash": "12a176252df63d1e3a958362d754c828991d64ade427ab11a2025098d1581976"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE generic_inference_jobs\nSET\n status = ?,\n failure_reason = ?,\n internal_debugging_failure_reason = ?,\n frontend_failure_category = ?,\n retry_at = NOW() + interval 2 minute\nWHERE id = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 5
},
"nullable": []
},
"hash": "1309910f97940b25bc163af0f62edd182848e5d4059dd5acf8c2387cda0d90cf"
}
@@ -1,12 +0,0 @@
{
"db_name": "SQLite",
"query": "\n UPDATE tasks\n SET is_dismissed_by_user = 1\n WHERE id = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 1
},
"nullable": []
},
"hash": "13d435d8f681b73e4080748dcef0579e246e41049af67e1bd79ffc06aa6ba974"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO media_upload_synthetic_ids\nSET\n user_token = ?,\n next_id = 1\nON DUPLICATE KEY UPDATE\n user_token = ?,\n next_id = next_id + 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "14794dde8b15b16fb0d9fb0456c5c66af53178efbf3020c8547a962bf75a9438"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE zs_voice_datasets\nSET\n user_deleted_at = CURRENT_TIMESTAMP\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 1
},
"nullable": []
},
"hash": "14a8b5b34df1037529494f1ca373094bfe0ca6e58ed36cf62946f26bb6fb4840"
}
@@ -0,0 +1,25 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n next_id\nFROM\n tts_result_synthetic_ids\nWHERE\n user_token = ?\nLIMIT 1\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "next_id",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 20
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false
]
},
"hash": "150c98c00f4cd6954428736583eae913be578c4e69dac317d4445bc0e97743c9"
}
@@ -0,0 +1,91 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n jobs.token as `job_token: tokens::tokens::generic_download_jobs::DownloadJobToken`,\n\n jobs.status,\n jobs.attempt_count,\n jobs.on_success_downloaded_entity_token as maybe_downloaded_entity_token,\n jobs.on_success_downloaded_entity_type as maybe_downloaded_entity_type,\n\n jobs.created_at,\n jobs.updated_at\n\nFROM generic_download_jobs as jobs\n\nWHERE jobs.token = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "job_token: tokens::tokens::generic_download_jobs::DownloadJobToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "status",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 2,
"name": "attempt_count",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 3
}
},
{
"ordinal": 3,
"name": "maybe_downloaded_entity_token",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 4,
"name": "maybe_downloaded_entity_type",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 5,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 6,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
true,
true,
false,
false
]
},
"hash": "1773939b9f98a452e61728eceed7a7e2936fc12e2e6027a732d56a1d5f2efbf0"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE w2l_templates\nSET\n is_public_listing_approved = ?,\n is_locked_from_user_modification = ?,\n is_locked_from_use = ?,\n maybe_mod_comments = ?,\n maybe_mod_user_token = ?,\n version = version + 1\nWHERE token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 6
},
"nullable": []
},
"hash": "17c8d210d93ee9c0d8e8422eed605c9150f19f9bf72affcf111b15a67a5b9e70"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE tts_inference_jobs\nSET\n status = \"dead\",\n failure_reason = ?,\n internal_debugging_failure_reason = ?,\n last_assigned_worker = ?,\n retry_at = NULL\nWHERE id = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 4
},
"nullable": []
},
"hash": "1bc8e8382345979e6cc618ce0360410258da1d376528b96ebf3b8d3d0f650147"
}
@@ -0,0 +1,223 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n tts.token as model_token,\n tts.tts_model_type,\n tts.text_pipeline_type,\n\n tts.use_default_mel_multiply_factor,\n tts.maybe_custom_mel_multiply_factor,\n\n tts.maybe_default_pretrained_vocoder,\n\n tts.maybe_custom_vocoder_token,\n vocoder.vocoder_type as `maybe_custom_vocoder_type: enums::common::vocoder_type::VocoderType`,\n vocoder.title as maybe_custom_vocoder_title,\n vocoder.private_bucket_hash as maybe_custom_vocoder_private_bucket_hash,\n\n tts.creator_user_token,\n users.username as creator_username,\n users.display_name as creator_display_name,\n tts.title,\n tts.private_bucket_hash,\n tts.created_at,\n tts.updated_at,\n tts.user_deleted_at,\n tts.mod_deleted_at\n\nFROM tts_models as tts\n\nJOIN users\n ON users.token = tts.creator_user_token\n\nLEFT OUTER JOIN vocoder_models AS vocoder\n ON vocoder.token = tts.maybe_custom_vocoder_token\n\nWHERE tts.token = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "model_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "tts_model_type",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 60
}
},
{
"ordinal": 2,
"name": "text_pipeline_type",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 3,
"name": "use_default_mel_multiply_factor",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 4,
"name": "maybe_custom_mel_multiply_factor",
"type_info": {
"type": "Double",
"flags": "",
"char_set": 63,
"max_size": 22
}
},
{
"ordinal": 5,
"name": "maybe_default_pretrained_vocoder",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 6,
"name": "maybe_custom_vocoder_token",
"type_info": {
"type": "VarString",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 7,
"name": "maybe_custom_vocoder_type: enums::common::vocoder_type::VocoderType",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 8,
"name": "maybe_custom_vocoder_title",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 9,
"name": "maybe_custom_vocoder_private_bucket_hash",
"type_info": {
"type": "String",
"flags": "MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 10,
"name": "creator_user_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 11,
"name": "creator_username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 12,
"name": "creator_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 13,
"name": "title",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 14,
"name": "private_bucket_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 15,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 16,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 17,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 18,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
true,
false,
true,
true,
true,
true,
true,
true,
false,
false,
false,
false,
false,
false,
false,
true,
true
]
},
"hash": "1bcb79b19d2e894bdbda7d9f717a8f22d580cfbb8294f0702b9ffaf7f3602145"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE user_sessions\nSET deleted_at = CURRENT_TIMESTAMP()\nWHERE\n token = ?\n AND deleted_at IS NULL\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 1
},
"nullable": []
},
"hash": "1cc62e5cdc8de18969d7e8018d91c38794e5a7d23f117e5b0a4126845f300e60"
}
@@ -1,12 +0,0 @@
{
"db_name": "SQLite",
"query": "\n UPDATE tasks\n SET\n task_status = ?,\n on_complete_batch_token = ?,\n on_complete_primary_media_file_token = ?,\n on_complete_primary_media_file_class = ?,\n on_complete_primary_media_file_cdn_url = ?,\n on_complete_primary_media_file_thumbnail_url_template = ?\n WHERE\n provider = ?\n AND provider_job_id = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 8
},
"nullable": []
},
"hash": "1e3758851fc8451670f86a9432009b73bdb81de4a08dcaa96a86afb5f9be7a68"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO voice_conversion_models\nSET\n token = ?,\n model_type = ?,\n title = ?,\n description_markdown = '',\n description_rendered_html = '',\n creator_user_token = ?,\n ip_address_creation = ?,\n ip_address_last_update = ?,\n original_download_url = ?,\n has_index_file = ?,\n private_bucket_hash = ?,\n private_bucket_object_name = ?,\n file_size_bytes = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 11
},
"nullable": []
},
"hash": "1e85e546684feffc151a26b0495b9ab8aa4ee5f1627464a9872e9c357ba1dc7a"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE generic_download_jobs\nSET\n status = \"complete_failure\",\n on_success_downloaded_entity_token = ?,\n on_success_downloaded_entity_type = ?,\n failure_reason = NULL,\n success_execution_millis = ?,\n retry_at = NULL\nWHERE id = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 4
},
"nullable": []
},
"hash": "2177f29265040bda6bb4418b521679fcbc372a73620415f4812c45fbb03d5933"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE model_categories\nSET\n name = ?,\n maybe_dropdown_name = ?,\n\n can_directly_have_models = ?,\n can_have_subcategories = ?,\n can_only_mods_apply = ?,\n\n maybe_super_category_token = ?,\n\n is_mod_approved = ?,\n maybe_mod_user_token = ?,\n maybe_mod_comments = ?,\n\n version = version + 1\n\nWHERE token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 10
},
"nullable": []
},
"hash": "218b3fe667b34bfa158bb7d4f600a3b91a22460adf566dcdf6ce540006e6c684"
}
@@ -0,0 +1,179 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n vocoder.token as vocoder_token,\n vocoder.vocoder_type as `vocoder_type: enums::common::vocoder_type::VocoderType`,\n vocoder.creator_user_token,\n users.username as creator_username,\n users.display_name as creator_display_name,\n users.email_gravatar_hash as creator_gravatar_hash,\n vocoder.title,\n vocoder.is_staff_recommended,\n vocoder.is_mod_disabled_from_public_use,\n vocoder.is_mod_disabled_from_author_use,\n vocoder.is_mod_author_editing_locked,\n vocoder.created_at,\n vocoder.updated_at,\n vocoder.user_deleted_at,\n vocoder.mod_deleted_at\nFROM vocoder_models as vocoder\nJOIN users\n ON users.token = vocoder.creator_user_token\nWHERE\n users.username = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "vocoder_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "vocoder_type: enums::common::vocoder_type::VocoderType",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 2,
"name": "creator_user_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 3,
"name": "creator_username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 4,
"name": "creator_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 5,
"name": "creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 6,
"name": "title",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 7,
"name": "is_staff_recommended",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 8,
"name": "is_mod_disabled_from_public_use",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 9,
"name": "is_mod_disabled_from_author_use",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 10,
"name": "is_mod_author_editing_locked",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 11,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 12,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 13,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 14,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
true,
true
]
},
"hash": "219165c1412716d2df3b791a81757180232c5f266384ad7e3e68ded4aa836d47"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO trending_model_analytics\nSET\n model_type = ?,\n model_token = ?,\n window_name = ?,\n numeric_value = ?,\n version = 1\n\nON DUPLICATE KEY UPDATE\n numeric_value = ?,\n version = version + 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 5
},
"nullable": []
},
"hash": "225a2fb97e75f4facadbef0d4ca3a4746f796cafc5ab017648a4b506b5da7fcc"
}
@@ -1,128 +0,0 @@
{
"db_name": "SQLite",
"query": "\n SELECT\n id,\n task_status,\n task_type,\n model_type,\n provider,\n provider_job_id,\n frontend_caller,\n frontend_subscriber_id,\n frontend_subscriber_payload,\n on_complete_primary_media_file_token,\n on_complete_primary_media_file_class,\n on_complete_batch_token,\n on_complete_primary_media_file_cdn_url,\n on_complete_primary_media_file_thumbnail_url_template,\n on_failure_type,\n on_failure_message,\n created_at as \"created_at: DateTime<Utc>\",\n updated_at as \"updated_at: DateTime<Utc>\",\n completed_at as \"completed_at: DateTime<Utc>\"\n FROM tasks\n WHERE is_dismissed_by_user == 0\n ",
"describe": {
"columns": [
{
"name": "id",
"ordinal": 0,
"type_info": "Text"
},
{
"name": "task_status",
"ordinal": 1,
"type_info": "Text"
},
{
"name": "task_type",
"ordinal": 2,
"type_info": "Text"
},
{
"name": "model_type",
"ordinal": 3,
"type_info": "Text"
},
{
"name": "provider",
"ordinal": 4,
"type_info": "Text"
},
{
"name": "provider_job_id",
"ordinal": 5,
"type_info": "Text"
},
{
"name": "frontend_caller",
"ordinal": 6,
"type_info": "Text"
},
{
"name": "frontend_subscriber_id",
"ordinal": 7,
"type_info": "Text"
},
{
"name": "frontend_subscriber_payload",
"ordinal": 8,
"type_info": "Text"
},
{
"name": "on_complete_primary_media_file_token",
"ordinal": 9,
"type_info": "Text"
},
{
"name": "on_complete_primary_media_file_class",
"ordinal": 10,
"type_info": "Text"
},
{
"name": "on_complete_batch_token",
"ordinal": 11,
"type_info": "Text"
},
{
"name": "on_complete_primary_media_file_cdn_url",
"ordinal": 12,
"type_info": "Text"
},
{
"name": "on_complete_primary_media_file_thumbnail_url_template",
"ordinal": 13,
"type_info": "Text"
},
{
"name": "on_failure_type",
"ordinal": 14,
"type_info": "Text"
},
{
"name": "on_failure_message",
"ordinal": 15,
"type_info": "Text"
},
{
"name": "created_at: DateTime<Utc>",
"ordinal": 16,
"type_info": "Int64"
},
{
"name": "updated_at: DateTime<Utc>",
"ordinal": 17,
"type_info": "Int64"
},
{
"name": "completed_at: DateTime<Utc>",
"ordinal": 18,
"type_info": "Int64"
}
],
"parameters": {
"Right": 0
},
"nullable": [
false,
false,
false,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
false,
false,
true
]
},
"hash": "2436eb7bf4b0e23a899311a67a77f71d89eb35461e2113e43cd9d221bfa91c9a"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO w2l_template_upload_jobs\nSET\n token = ?,\n uuid_idempotency_token = ?,\n creator_user_token = ?,\n creator_ip_address = ?,\n creator_set_visibility = ?,\n title = ?,\n template_type = ?,\n download_url = ?,\n status = \"pending\"\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 8
},
"nullable": []
},
"hash": "25e7858d370ac1359deb42ef5292e85ccd1fe7debf3a1ba73303e5882523a4d0"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE zs_voice_dataset_samples\nSET\n mod_deleted_at = NULL,\n maybe_mod_user_token = ?\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "26405d99f95c323a51547736e8fa52bfb59281c70a31b12d4dd0fb0488f22b9c"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\n INSERT INTO model_weights\n SET\n token = ?,\n weights_type = ?,\n weights_category = ?,\n title = ?,\n maybe_thumbnail_token = ?,\n description_markdown = ?,\n description_rendered_html = ?,\n creator_user_token = ?,\n creator_ip_address = ?,\n creator_set_visibility = ?,\n maybe_last_update_user_token = ?,\n original_download_url = ?,\n original_filename = ?,\n file_size_bytes = ?,\n file_checksum_sha2 = ?,\n private_bucket_hash = ?,\n maybe_private_bucket_prefix = ?,\n maybe_private_bucket_extension = ?,\n cached_user_ratings_total_count = ?,\n cached_user_ratings_positive_count = ?,\n cached_user_ratings_negative_count = ?,\n maybe_cached_user_ratings_ratio = ?,\n version = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 23
},
"nullable": []
},
"hash": "274cfb1e3caca706e3dbc3d95064e0f4b354c936f8de948070854920f265cc41"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO tts_result_synthetic_ids\nSET\n user_token = ?,\n next_id = 1\nON DUPLICATE KEY UPDATE\n user_token = ?,\n next_id = next_id + 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "28cf5843d68d6cb0e67eb316ef9e7e5fb05a6be2433f86c081576b279167508d"
}
@@ -0,0 +1,25 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n next_id\nFROM\n media_upload_synthetic_ids\nWHERE\n user_token = ?\nLIMIT 1\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "next_id",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 20
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false
]
},
"hash": "28f7b4729ae693d156b59fc532e45a2a89495dcbf181ee1825b14e2ca47fcd64"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE w2l_template_upload_jobs\nSET\n status = ?,\n failure_reason = ?,\n retry_at = NOW() + interval 2 minute\nWHERE id = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "294c089b17fdd87d7e579c05a9d90e9bfa5b7465cafa9a95af08d58709212440"
}
@@ -0,0 +1,25 @@
{
"db_name": "MySQL",
"query": "\n SELECT\n count(*) AS use_count\n FROM\n tts_results\n WHERE\n created_at > ( CURDATE() - INTERVAL ? MINUTE )\n AND model_token = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "use_count",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL | BINARY",
"char_set": 63,
"max_size": 21
}
}
],
"parameters": {
"Right": 2
},
"nullable": [
false
]
},
"hash": "29764c89bec917b0d8e4eaae25372ede56d51114a8641e3423c0cf72212542eb"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE comments\nSET\n comment_markdown = ?,\n comment_rendered_html = ?,\n editor_ip_address = ?,\n edited_at = NOW(),\n version = version + 1\nWHERE\n token = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 4
},
"nullable": []
},
"hash": "29a775fceaaf8aa5a6d5173eef8acc69e089f2ebf5b62ca82b1d112ac98d66ec"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE w2l_inference_jobs\nSET\n status = ?,\n failure_reason = ?,\n retry_at = NOW() + interval 2 minute\nWHERE id = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "2b04dd7db52ef3a97a6f420a22a4dbee7416ae58697438df69e87ffd47bbf350"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE tts_models\nSET\n maybe_mod_user_token = ?,\n mod_deleted_at = CURRENT_TIMESTAMP\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "2b80162b8957ac044f245af93d678aee976535d58fe0de0b39087323aa720792"
}
@@ -0,0 +1,36 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n COUNT(distinct token) as record_count,\n NOW() as present_time\nFROM\n(\n SELECT token\n FROM generic_inference_jobs\n WHERE status = \"started\"\n AND created_at > (CURDATE() - INTERVAL 5 MINUTE)\nUNION\n SELECT token\n FROM generic_inference_jobs\n WHERE status IN (\"pending\", \"attempt_failed\")\n) as t\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "record_count",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL | BINARY",
"char_set": 63,
"max_size": 21
}
},
{
"ordinal": 1,
"name": "present_time",
"type_info": {
"type": "Datetime",
"flags": "NOT_NULL | BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 0
},
"nullable": [
false,
false
]
},
"hash": "2b95f70b52691b5ff91e4d4244b0ee982c0788efad4e30fabd0543683138af07"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO generic_synthetic_ids\nSET\n user_token = ?,\n id_category = ?,\n next_id = 1\nON DUPLICATE KEY UPDATE\n user_token = ?,\n id_category = ?,\n next_id = next_id + 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 4
},
"nullable": []
},
"hash": "2e3e69fed69902156c8f9b7daf3b9a381bf8f827ae7dcf4c7d37e7119e89d240"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE generic_download_jobs\nSET\n status = ?,\n failure_reason = ?,\n retry_at = NOW() + interval 2 minute\nWHERE id = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "2eac55b160ebbc67b5201050808b23056ebc53fb2b89f1437a481174b36b80ce"
}
@@ -0,0 +1,179 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n c.token as `token: tokens::tokens::comments::CommentToken`,\n c.user_token as `user_token: tokens::tokens::users::UserToken`,\n u.username,\n u.display_name as user_display_name,\n u.email_gravatar_hash as user_gravatar_hash,\n\n c.comment_markdown,\n c.comment_rendered_html,\n\n c.creator_ip_address,\n c.editor_ip_address,\n\n c.created_at,\n c.updated_at,\n c.edited_at,\n c.user_deleted_at,\n c.mod_deleted_at,\n c.object_owner_deleted_at\n\nFROM\n comments AS c\nJOIN users AS u\n ON c.user_token = u.token\nWHERE\n c.entity_type = ?\n AND c.entity_token = ?\n AND c.user_deleted_at IS NULL\n AND c.mod_deleted_at IS NULL\n AND c.object_owner_deleted_at IS NULL\nORDER BY c.id DESC\nLIMIT 50\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "token: tokens::tokens::comments::CommentToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "user_token: tokens::tokens::users::UserToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 2,
"name": "username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 3,
"name": "user_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 4,
"name": "user_gravatar_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 5,
"name": "comment_markdown",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 6,
"name": "comment_rendered_html",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 7,
"name": "creator_ip_address",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 8,
"name": "editor_ip_address",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 9,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 10,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 11,
"name": "edited_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 12,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 13,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 14,
"name": "object_owner_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 2
},
"nullable": [
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
true,
true,
true,
true
]
},
"hash": "30168a545d7c8895126e44e6950546974ae4129208df18d55165eb6445311114"
}
@@ -1,12 +0,0 @@
{
"db_name": "SQLite",
"query": "\n UPDATE tasks\n SET task_status = \"cancelled_by_user\"\n WHERE task_status NOT IN (\n \"complete_success\",\n \"complete_failure\",\n \"dead\",\n \"cancelled_by_user\",\n \"cancelled_by_provider\",\n \"cancelled_by_us\"\n )\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 0
},
"nullable": []
},
"hash": "30272128d83543d9fbfca930b7cdd4af30adfb4d90f2de044463a111c6340495"
}
@@ -0,0 +1,25 @@
{
"db_name": "MySQL",
"query": "\nSELECT 1 as does_exist\nFROM user_badges\nWHERE\n user_token = ?\nAND\n badge_slug = ?\nLIMIT 1\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "does_exist",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL | BINARY",
"char_set": 63,
"max_size": 2
}
}
],
"parameters": {
"Right": 2
},
"nullable": [
false
]
},
"hash": "314904656a333caa75a8644e73f4d338b7bd6f68c7ea9e37b5bc7f7b257bf34d"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE tts_models\nSET\n is_public_listing_approved = ?,\n is_locked_from_user_modification = ?,\n is_locked_from_use = ?,\n maybe_mod_comments = ?,\n maybe_mod_user_token = ?,\n is_front_page_featured = ?,\n is_twitch_featured = ?,\n maybe_suggested_unique_bot_command = ?,\n use_default_mel_multiply_factor = ?,\n maybe_custom_mel_multiply_factor = ?,\n version = version + 1\nWHERE token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 11
},
"nullable": []
},
"hash": "325fa77b36c1eb8ff8a67beb8db8d3cbf6224e8e619fbcf2bf0daa54bdf51e06"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE w2l_results\nSET\n creator_set_visibility = ?,\n maybe_mod_user_token = ?\nWHERE token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "33cd0c0b8eaaf494ef97232ac89775b8eb6a22d310824b7aa7db310dd4fd41b1"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO users (\n token,\n username,\n display_name,\n email_address,\n email_gravatar_hash,\n profile_markdown,\n profile_rendered_html,\n user_role_slug,\n password_hash,\n ip_address_creation,\n ip_address_last_login,\n ip_address_last_update\n)\nVALUES ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? )\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 12
},
"nullable": []
},
"hash": "34364f9bc851971f8291f5f9942dd23d10718ccb210a93a236d96d0591f65f35"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO user_sessions (\n token,\n user_token,\n ip_address_creation,\n expires_at\n)\nVALUES ( ?, ?, ?, NOW() + interval 1 year )\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "345cbabbe69652c89ccd384ed7db44f70c53791488cf63721f9563291b45db3e"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO w2l_result_synthetic_ids\nSET\n user_token = ?,\n next_id = 1\nON DUPLICATE KEY UPDATE\n user_token = ?,\n next_id = next_id + 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "34642399c3e91960768cb659b6006db291574d9cd07a5bace3db573eff20c3fb"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE\n ip_address_bans\nSET\n mod_user_token = ?,\n deleted_at = NULL\nWHERE\n ip_address = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "346c02b215cb35efaa35fe96d866a8c9056ac46e987b4e01f64222259dccdcbf"
}
@@ -0,0 +1,102 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n mu.token as `token: tokens::tokens::media_uploads::MediaUploadToken`,\n mu.media_type as `media_type: enums::by_table::media_uploads::media_upload_type::MediaUploadType`,\n mu.maybe_original_filename,\n mu.original_file_size_bytes,\n mu.original_duration_millis,\n mu.creator_set_visibility as `creator_set_visibility: enums::common::visibility::Visibility`,\n mu.created_at,\n mu.updated_at\nFROM media_uploads as mu\nWHERE\n mu.maybe_creator_user_token = ?\n AND mu.maybe_creator_user_token IS NOT NULL\n AND mu.media_type = ?\n AND mu.user_deleted_at IS NULL\n AND mu.mod_deleted_at IS NULL\nORDER BY id DESC\nLIMIT 25\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "token: tokens::tokens::media_uploads::MediaUploadToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "media_type: enums::by_table::media_uploads::media_upload_type::MediaUploadType",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 2,
"name": "maybe_original_filename",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 3,
"name": "original_file_size_bytes",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 4,
"name": "original_duration_millis",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 5,
"name": "creator_set_visibility: enums::common::visibility::Visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 6,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 7,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 2
},
"nullable": [
false,
false,
true,
false,
false,
false,
false,
false
]
},
"hash": "34afe8ddbf0fb5d746ec82827166348ae1a0734ca5986a7d696860efd90128ce"
}
@@ -1,86 +0,0 @@
{
"db_name": "SQLite",
"query": "\n SELECT\n id,\n task_status,\n task_type,\n model_type,\n provider,\n provider_job_id,\n frontend_caller,\n queue_status_url,\n queue_response_url,\n prompt_token,\n frontend_subscriber_id,\n frontend_subscriber_payload\n FROM tasks\n WHERE\n provider = ?\n AND provider_job_id = ?\n ",
"describe": {
"columns": [
{
"name": "id",
"ordinal": 0,
"type_info": "Text"
},
{
"name": "task_status",
"ordinal": 1,
"type_info": "Text"
},
{
"name": "task_type",
"ordinal": 2,
"type_info": "Text"
},
{
"name": "model_type",
"ordinal": 3,
"type_info": "Text"
},
{
"name": "provider",
"ordinal": 4,
"type_info": "Text"
},
{
"name": "provider_job_id",
"ordinal": 5,
"type_info": "Text"
},
{
"name": "frontend_caller",
"ordinal": 6,
"type_info": "Text"
},
{
"name": "queue_status_url",
"ordinal": 7,
"type_info": "Text"
},
{
"name": "queue_response_url",
"ordinal": 8,
"type_info": "Text"
},
{
"name": "prompt_token",
"ordinal": 9,
"type_info": "Text"
},
{
"name": "frontend_subscriber_id",
"ordinal": 10,
"type_info": "Text"
},
{
"name": "frontend_subscriber_payload",
"ordinal": 11,
"type_info": "Text"
}
],
"parameters": {
"Right": 2
},
"nullable": [
false,
false,
false,
true,
true,
true,
true,
true,
true,
true,
true,
true
]
},
"hash": "35677894f7b02f32a1bf6396fa6d10caba69bb0f3f03ee7ffbfa1437689d42df"
}
@@ -0,0 +1,179 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n vocoder.token as vocoder_token,\n vocoder.vocoder_type as `vocoder_type: enums::common::vocoder_type::VocoderType`,\n vocoder.creator_user_token,\n users.username as creator_username,\n users.display_name as creator_display_name,\n users.email_gravatar_hash as creator_gravatar_hash,\n vocoder.title,\n vocoder.is_staff_recommended,\n vocoder.is_mod_disabled_from_public_use,\n vocoder.is_mod_disabled_from_author_use,\n vocoder.is_mod_author_editing_locked,\n vocoder.created_at,\n vocoder.updated_at,\n vocoder.user_deleted_at,\n vocoder.mod_deleted_at\nFROM vocoder_models as vocoder\nJOIN users\n ON users.token = vocoder.creator_user_token\nWHERE\n users.username = ?\n AND vocoder.is_mod_disabled_from_public_use IS FALSE\n AND vocoder.is_mod_disabled_from_author_use IS FALSE\n AND vocoder.user_deleted_at IS NULL\n AND vocoder.mod_deleted_at IS NULL\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "vocoder_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "vocoder_type: enums::common::vocoder_type::VocoderType",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 2,
"name": "creator_user_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 3,
"name": "creator_username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 4,
"name": "creator_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 5,
"name": "creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 6,
"name": "title",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 7,
"name": "is_staff_recommended",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 8,
"name": "is_mod_disabled_from_public_use",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 9,
"name": "is_mod_disabled_from_author_use",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 10,
"name": "is_mod_author_editing_locked",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL | MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 11,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 12,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 13,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 14,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
false,
true,
true
]
},
"hash": "359be6ce263afd62fc748c14c06c62ded5ed59fc0a9d1186967028af400d7d61"
}
@@ -0,0 +1,124 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n mu.token as `token: tokens::tokens::media_uploads::MediaUploadToken`,\n mu.media_type as `media_type: enums::by_table::media_uploads::media_upload_type::MediaUploadType`,\n mu.maybe_original_filename,\n mu.public_bucket_directory_hash,\n mu.original_file_size_bytes,\n mu.original_duration_millis,\n mu.maybe_extra_file_modification_info,\n mu.creator_set_visibility as `creator_set_visibility: enums::common::visibility::Visibility`,\n mu.created_at,\n mu.updated_at\nFROM media_uploads as mu\nWHERE\n mu.token = ?\n AND mu.user_deleted_at IS NULL\n AND mu.mod_deleted_at IS NULL\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "token: tokens::tokens::media_uploads::MediaUploadToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "media_type: enums::by_table::media_uploads::media_upload_type::MediaUploadType",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 2,
"name": "maybe_original_filename",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 3,
"name": "public_bucket_directory_hash",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 4,
"name": "original_file_size_bytes",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 5,
"name": "original_duration_millis",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 6,
"name": "maybe_extra_file_modification_info",
"type_info": {
"type": "Blob",
"flags": "BLOB | BINARY",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 7,
"name": "creator_set_visibility: enums::common::visibility::Visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 8,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 9,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
true,
false,
false,
false,
true,
false,
false,
false
]
},
"hash": "366bc2a90afff0e0ff6b15d39c6815bf50f116ebdf99485aa909a647d52809dd"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nINSERT INTO w2l_results\nSET\n token = ?,\n maybe_w2l_template_token = ?,\n maybe_creator_user_token = ?,\n creator_ip_address = ?,\n creator_set_visibility = ?,\n\n maybe_creator_synthetic_id = ?,\n\n public_bucket_video_path = ?,\n\n file_size_bytes = ?,\n mime_type = ?,\n frame_width = ?,\n frame_height = ?,\n duration_millis = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 12
},
"nullable": []
},
"hash": "369a7576edc128cf2b310648d6fc45a2191c1263d433fe6d1461d15dbf26690e"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE tts_results\nSET\n mod_deleted_at = CURRENT_TIMESTAMP,\n maybe_mod_user_token = ?\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "376e36b1357952599866262c7356ba35f15ccdfb338d8ccdbdc06ccd69331fc3"
}
@@ -0,0 +1,311 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n tts_results.token as tts_result_token,\n\n tts_results.raw_inference_text,\n\n tts_results.model_token as tts_model_token,\n tts_models.title as tts_model_title,\n\n tts_results.maybe_pretrained_vocoder_used,\n\n users.token as `maybe_creator_user_token: tokens::tokens::users::UserToken`,\n users.username as maybe_creator_username,\n users.display_name as maybe_creator_display_name,\n users.email_gravatar_hash as maybe_creator_gravatar_hash,\n users.is_banned as maybe_creator_is_banned,\n\n model_users.token as maybe_model_creator_user_token,\n model_users.username as maybe_model_creator_username,\n model_users.display_name as maybe_model_creator_display_name,\n model_users.email_gravatar_hash as maybe_model_creator_gravatar_hash,\n model_users.is_banned as maybe_model_creator_is_banned,\n\n tts_results.public_bucket_wav_audio_path,\n tts_results.public_bucket_spectrogram_path,\n\n tts_results.creator_set_visibility,\n\n tts_results.generated_by_worker,\n tts_results.is_debug_request,\n\n tts_results.file_size_bytes,\n tts_results.duration_millis,\n tts_results.created_at,\n tts_results.updated_at,\n\n tts_results.creator_ip_address,\n tts_results.user_deleted_at,\n tts_results.mod_deleted_at\n\nFROM tts_results\nLEFT OUTER JOIN tts_models\n ON tts_results.model_token = tts_models.token\nLEFT OUTER JOIN users\n ON tts_results.maybe_creator_user_token = users.token\nLEFT OUTER JOIN users as model_users\n ON tts_models.creator_user_token = model_users.token\nWHERE\n tts_results.token = ?\n AND tts_results.user_deleted_at IS NULL\n AND tts_results.mod_deleted_at IS NULL\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "tts_result_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "raw_inference_text",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 2,
"name": "tts_model_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 3,
"name": "tts_model_title",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 4,
"name": "maybe_pretrained_vocoder_used",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 5,
"name": "maybe_creator_user_token: tokens::tokens::users::UserToken",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 6,
"name": "maybe_creator_username",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 7,
"name": "maybe_creator_display_name",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 8,
"name": "maybe_creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 9,
"name": "maybe_creator_is_banned",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 10,
"name": "maybe_model_creator_user_token",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 11,
"name": "maybe_model_creator_username",
"type_info": {
"type": "VarString",
"flags": "UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 12,
"name": "maybe_model_creator_display_name",
"type_info": {
"type": "VarString",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 13,
"name": "maybe_model_creator_gravatar_hash",
"type_info": {
"type": "String",
"flags": "BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 14,
"name": "maybe_model_creator_is_banned",
"type_info": {
"type": "Tiny",
"flags": "",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 15,
"name": "public_bucket_wav_audio_path",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 16,
"name": "public_bucket_spectrogram_path",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 17,
"name": "creator_set_visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 18,
"name": "generated_by_worker",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 19,
"name": "is_debug_request",
"type_info": {
"type": "Tiny",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 20,
"name": "file_size_bytes",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 21,
"name": "duration_millis",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 22,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 23,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 24,
"name": "creator_ip_address",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 25,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 26,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "MULTIPLE_KEY | BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
true,
false,
false,
false,
true,
false,
false,
false,
false,
false,
false,
true,
true
]
},
"hash": "386edf6842d78c963b0ab35a25b8d00f65abb529e2a5e4c206895ac9a807085a"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE zs_voices\nSET\n user_deleted_at = NULL\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 1
},
"nullable": []
},
"hash": "38b10387d6c414ad86b7c85e7e320f1077e2f9b5cfa04124194a3eeff48a9391"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\n UPDATE model_categories\n SET\n deleted_at = NULL\n WHERE\n token = ?\n LIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 1
},
"nullable": []
},
"hash": "38ce91eb179896e874b63f7d35ceb78004f5ef1c7d31af3fa6b0121f47de9cfb"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE media_files\nSET\n mod_deleted_at = CURRENT_TIMESTAMP,\n\n maybe_mod_user_token = ?\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "391803c24282df23f933f1f3f8db9350a4cc7be50b3c07f267d795f736958527"
}
@@ -0,0 +1,36 @@
{
"db_name": "MySQL",
"query": "\nSELECT public_count, all_count FROM (\n (SELECT count(*) as public_count\n FROM tts_models\n WHERE user_deleted_at IS NULL\n AND mod_deleted_at IS NULL) as pc,\n (SELECT count(*) as all_count\n FROM tts_models) as ac\n)\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "public_count",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 21
}
},
{
"ordinal": 1,
"name": "all_count",
"type_info": {
"type": "LongLong",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 21
}
}
],
"parameters": {
"Right": 0
},
"nullable": [
false,
false
]
},
"hash": "3a079cf76bcdfeb2c6f11e54c4afe1054fa39e6a7cf1c45254fd12d2b691f6c4"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE users\nSET\n profile_markdown = ?,\n profile_rendered_html = ?,\n discord_username = ?,\n twitter_username = ?,\n twitch_username = ?,\n github_username = ?,\n cashapp_username = ?,\n website_url = ?,\n version = version + 1\n\nWHERE users.token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 9
},
"nullable": []
},
"hash": "3a2dc0a7e41dcbdf21f91d1a1e54e813f74b0bac7aea052302089cae195eeb53"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE email_sender_jobs\nSET\n status = 'started',\n assigned_worker = ?,\n assigned_cluster = ?,\n attempt_count = attempt_count + 1,\n retry_at = NOW() + interval 2 minute,\n first_started_at = NOW()\nWHERE id = ?\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 3
},
"nullable": []
},
"hash": "3ae0f9336e1f651533cb6e07e8fb64bb1036721cfe77556273ee23d1d15d88ab"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE zs_voice_dataset_samples\nSET\n mod_deleted_at = CURRENT_TIMESTAMP,\n maybe_mod_user_token = ?\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "3c72b6c08fd2c9c43e8eb09db912a1bc875d45e738550dc5d29db6ca63c57d8f"
}
@@ -0,0 +1,355 @@
{
"db_name": "MySQL",
"query": "\n SELECT \n mw.token as `token: tokens::tokens::model_weights::ModelWeightToken`,\n mw.title,\n mw.weights_type as `weights_type: enums::by_table::model_weights::weights_types::WeightsType`,\n mw.weights_category as `weights_category: enums::by_table::model_weights::weights_category::WeightsCategory`,\n mw.maybe_thumbnail_token,\n mw.description_markdown,\n mw.description_rendered_html,\n users.token as `creator_user_token: tokens::tokens::users::UserToken`,\n users.username as creator_username,\n users.display_name as creator_display_name,\n users.email_gravatar_hash as creator_email_gravatar_hash,\n mw.creator_ip_address,\n mw.creator_set_visibility as `creator_set_visibility: enums::common::visibility::Visibility`,\n mw.maybe_last_update_user_token as `maybe_last_update_user_token: tokens::tokens::users::UserToken`,\n mw.original_download_url,\n mw.original_filename,\n mw.file_size_bytes,\n mw.file_checksum_sha2,\n mw.private_bucket_hash,\n mw.maybe_private_bucket_prefix,\n mw.maybe_private_bucket_extension,\n mw.cached_user_ratings_negative_count,\n mw.cached_user_ratings_positive_count,\n mw.cached_user_ratings_total_count,\n mw.maybe_cached_user_ratings_ratio,\n mw.cached_user_ratings_last_updated_at,\n mw.version,\n mw.created_at,\n mw.updated_at,\n mw.user_deleted_at,\n mw.mod_deleted_at\n FROM model_weights as mw\n JOIN users\n ON users.token = mw.creator_user_token\n WHERE\n users.username = ?\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "token: tokens::tokens::model_weights::ModelWeightToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "title",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 2,
"name": "weights_type: enums::by_table::model_weights::weights_types::WeightsType",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 3,
"name": "weights_category: enums::by_table::model_weights::weights_category::WeightsCategory",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 4,
"name": "maybe_thumbnail_token",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 5,
"name": "description_markdown",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 6,
"name": "description_rendered_html",
"type_info": {
"type": "Blob",
"flags": "NOT_NULL | BLOB | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 262140
}
},
{
"ordinal": 7,
"name": "creator_user_token: tokens::tokens::users::UserToken",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 8,
"name": "creator_username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 9,
"name": "creator_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 10,
"name": "creator_email_gravatar_hash",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 11,
"name": "creator_ip_address",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 160
}
},
{
"ordinal": 12,
"name": "creator_set_visibility: enums::common::visibility::Visibility",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 13,
"name": "maybe_last_update_user_token: tokens::tokens::users::UserToken",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 14,
"name": "original_download_url",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 2048
}
},
{
"ordinal": 15,
"name": "original_filename",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 16,
"name": "file_size_bytes",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 17,
"name": "file_checksum_sha2",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 256
}
},
{
"ordinal": 18,
"name": "private_bucket_hash",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 19,
"name": "maybe_private_bucket_prefix",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 20,
"name": "maybe_private_bucket_extension",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 64
}
},
{
"ordinal": 21,
"name": "cached_user_ratings_negative_count",
"type_info": {
"type": "Long",
"flags": "NOT_NULL | UNSIGNED",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 22,
"name": "cached_user_ratings_positive_count",
"type_info": {
"type": "Long",
"flags": "NOT_NULL | UNSIGNED",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 23,
"name": "cached_user_ratings_total_count",
"type_info": {
"type": "Long",
"flags": "NOT_NULL | UNSIGNED",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 24,
"name": "maybe_cached_user_ratings_ratio",
"type_info": {
"type": "Float",
"flags": "",
"char_set": 63,
"max_size": 12
}
},
{
"ordinal": 25,
"name": "cached_user_ratings_last_updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 26,
"name": "version",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 11
}
},
{
"ordinal": 27,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 28,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 29,
"name": "user_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 30,
"name": "mod_deleted_at",
"type_info": {
"type": "Timestamp",
"flags": "BINARY",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 1
},
"nullable": [
false,
false,
false,
false,
true,
false,
false,
false,
false,
false,
false,
false,
false,
true,
true,
true,
false,
false,
false,
true,
true,
false,
false,
false,
true,
false,
false,
false,
false,
true,
true
]
},
"hash": "3d586592422727dcc928574966bdf5081ac69fdbb856fffcbd68187fd99c4642"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE model_weights\nSET\n mod_deleted_at = NULL\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 1
},
"nullable": []
},
"hash": "3dfc7f22c16543116c4ca17f5bee0336f5cfa1522681ba1bb6b1874cd8f13297"
}
@@ -0,0 +1,12 @@
{
"db_name": "MySQL",
"query": "\nUPDATE tts_results\nSET\n mod_deleted_at = NULL,\n maybe_mod_user_token = ?\nWHERE\n token = ?\nLIMIT 1\n ",
"describe": {
"columns": [],
"parameters": {
"Right": 2
},
"nullable": []
},
"hash": "40a3301e9a3201e74d49b6b339f67291e2ae22d315188401708609ac2d28a68c"
}
@@ -0,0 +1,168 @@
{
"db_name": "MySQL",
"query": "\nSELECT\n w2l.token as template_token,\n w2l.template_type,\n w2l.creator_user_token,\n users.username as creator_username,\n users.display_name as creator_display_name,\n w2l.title,\n w2l.frame_width,\n w2l.frame_height,\n w2l.duration_millis,\n w2l.maybe_public_bucket_preview_image_object_name,\n w2l.maybe_public_bucket_preview_video_object_name,\n w2l.is_public_listing_approved,\n w2l.created_at,\n w2l.updated_at\nFROM w2l_templates as w2l\nJOIN users\n ON users.token = w2l.creator_user_token\nWHERE\n w2l.is_public_listing_approved IS TRUE\n AND w2l.user_deleted_at IS NULL\n AND w2l.mod_deleted_at IS NULL\n ",
"describe": {
"columns": [
{
"ordinal": 0,
"name": "template_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 1,
"name": "template_type",
"type_info": {
"type": "String",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | ENUM",
"char_set": 224,
"max_size": 28
}
},
{
"ordinal": 2,
"name": "creator_user_token",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | MULTIPLE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 128
}
},
{
"ordinal": 3,
"name": "creator_username",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | UNIQUE_KEY | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 4,
"name": "creator_display_name",
"type_info": {
"type": "VarString",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 80
}
},
{
"ordinal": 5,
"name": "title",
"type_info": {
"type": "String",
"flags": "NOT_NULL | BINARY | NO_DEFAULT_VALUE",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 6,
"name": "frame_width",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 7,
"name": "frame_height",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 8,
"name": "duration_millis",
"type_info": {
"type": "Long",
"flags": "NOT_NULL",
"char_set": 63,
"max_size": 10
}
},
{
"ordinal": 9,
"name": "maybe_public_bucket_preview_image_object_name",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 10,
"name": "maybe_public_bucket_preview_video_object_name",
"type_info": {
"type": "VarString",
"flags": "BINARY",
"char_set": 224,
"max_size": 1020
}
},
{
"ordinal": 11,
"name": "is_public_listing_approved",
"type_info": {
"type": "Tiny",
"flags": "MULTIPLE_KEY",
"char_set": 63,
"max_size": 1
}
},
{
"ordinal": 12,
"name": "created_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP",
"char_set": 63,
"max_size": 19
}
},
{
"ordinal": 13,
"name": "updated_at",
"type_info": {
"type": "Timestamp",
"flags": "NOT_NULL | BINARY | TIMESTAMP | ON_UPDATE_NOW",
"char_set": 63,
"max_size": 19
}
}
],
"parameters": {
"Right": 0
},
"nullable": [
false,
false,
false,
false,
false,
false,
false,
false,
false,
true,
true,
true,
false,
false
]
},
"hash": "417dd070beeaf6ccd86852b7e99bf7fda5c5b15da4a3bcc066a0e2bb90ca7df1"
}

Some files were not shown because too many files have changed in this diff Show More