kasisnu
1cffbbcf35
something
2023-12-05 23:09:11 +05:30
Brandon Thomas
c5c1187e24
global list of media files
2023-12-05 01:29:52 -05:00
Brandon Thomas
b9f604dd18
reusable pagination types
2023-12-04 23:11:41 -05:00
Brandon Thomas
e6f5ecb980
Merge pull request #186 from storytold/brandon-list-media-files-for-user
...
list media files for user
2023-12-04 22:02:53 -05:00
Brandon Thomas
2e3ff8a730
list media files for user
2023-12-04 21:59:39 -05:00
Brandon Thomas
28770ef736
fix query issue
2023-12-04 05:00:46 -05:00
Brandon Thomas
894084fba6
Merge pull request #181 from storytold/brandon-queue-controls
...
Kill inference jobs (mod endpoint)
2023-12-04 03:54:05 -05:00
Brandon Thomas
4bf1a25fbb
Kill inference jobs (mod endpoint)
2023-12-04 03:46:29 -05:00
Brandon Thomas
b0a9342194
updated queue stats
2023-12-01 07:09:23 -05:00
Brandon Thomas
3cc1ea6935
capture stderr for svc and rvc
2023-12-01 01:36:33 -05:00
Brandon Thomas
b74cf7853d
fix web break
2023-11-30 22:46:35 -05:00
Brandon Thomas
3cdce86162
warn on slow batch queries
2023-11-30 17:25:23 -05:00
Brandon Thomas
b0a87e83a0
log batch index
2023-11-30 17:19:23 -05:00
Brandon Thomas
979c234ed2
cleanup logging
2023-11-30 16:27:25 -05:00
Brandon Thomas
4837106d37
distinguish logs
2023-11-30 16:10:01 -05:00
Brandon Thomas
cfd92e814d
Merge pull request #166 from storytold/dependabot/cargo/env_logger-0.10.1
...
Bump env_logger from 0.7.1 to 0.10.1
2023-11-30 16:02:23 -05:00
Brandon Thomas
6d27214a14
codegen
2023-11-30 15:50:05 -05:00
Brandon Thomas
b628fb0a11
premium TTS duration
2023-11-30 15:21:07 -05:00
dependabot[bot]
456b9e1ce6
Bump env_logger from 0.7.1 to 0.10.1
...
Bumps [env_logger](https://github.com/rust-cli/env_logger ) from 0.7.1 to 0.10.1.
- [Release notes](https://github.com/rust-cli/env_logger/releases )
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md )
- [Commits](https://github.com/rust-cli/env_logger/compare/v0.7.1...v0.10.1 )
---
updated-dependencies:
- dependency-name: env_logger
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-30 09:35:18 +00:00
Brandon Thomas
6f7b6da595
Merge pull request #167 from storytold/dependabot/cargo/rand-0.8.5
...
Bump rand from 0.7.3 to 0.8.5
2023-11-30 04:33:54 -05:00
Brandon Thomas
18ad28135f
safe delete
2023-11-30 02:36:33 -05:00
Brandon Thomas
ff4a3115d2
clear up more directories when file system is full
2023-11-30 02:34:33 -05:00
dependabot[bot]
ccae943037
Bump rand from 0.7.3 to 0.8.5
...
Bumps [rand](https://github.com/rust-random/rand ) from 0.7.3 to 0.8.5.
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-random/rand/compare/0.7.3...0.8.5 )
---
updated-dependencies:
- dependency-name: rand
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-30 07:32:36 +00:00
Brandon Thomas
12ef105ced
fix errors
2023-11-30 02:27:08 -05:00
Brandon Thomas
b27070e23e
get rid of more of container_common
2023-11-30 02:25:16 -05:00
Brandon Thomas
8e45a4ea45
delete mod
2023-11-30 02:05:15 -05:00
Brandon Thomas
a669ac7f03
move remaining container_common::files -> filesys crate
2023-11-30 02:04:41 -05:00
Brandon Thomas
b5ed9acdd4
move check_directory_exists to filesys crate
2023-11-30 01:56:55 -05:00
Brandon Thomas
ff2aaa9f3d
move check_file_exists to filesys crate
2023-11-30 01:53:42 -05:00
Brandon Thomas
f93421eadc
keep IoError around; better casting
2023-11-30 01:35:48 -05:00
Brandon Thomas
b82ffcce86
much more StorageFull error !
2023-11-30 01:26:03 -05:00
Brandon Thomas
e2c5839d01
surface storage full errors
2023-11-30 01:05:26 -05:00
Brandon Thomas
896e8591ba
cleanup
2023-11-29 23:10:15 -05:00
Brandon Thomas
19dcfdc629
cleanup
2023-11-29 22:51:12 -05:00
Brandon Thomas
cec7bce450
try copy instead
2023-11-29 22:49:00 -05:00
Brandon Thomas
6cc3062da8
don't fail if file is gone (not sure why this happens)
2023-11-29 22:01:53 -05:00
Brandon Thomas
efdd03bbbd
logging
2023-11-29 21:50:30 -05:00
Brandon Thomas
c207356ac5
cleanup retry
2023-11-29 21:44:20 -05:00
Brandon Thomas
3243cc51b7
try to delete and re-copy
2023-11-29 21:36:47 -05:00
Brandon Thomas
ee4af2976f
flag to permit cold filesystem cache
2023-11-29 21:26:03 -05:00
Brandon Thomas
4fb2a38c68
report temp file size
2023-11-29 21:10:01 -05:00
Brandon Thomas
a549ceb609
check vocoder and synthesizer sizes
2023-11-29 20:53:00 -05:00
Brandon Thomas
003f0cdeea
struct args for downloader (safer)
2023-11-29 20:46:33 -05:00
Brandon Thomas
9e0772141a
download file size check and logging
2023-11-29 20:25:37 -05:00
Brandon Thomas
542b79dd90
log http errors
2023-11-29 19:49:52 -05:00
Brandon Thomas
363f8cbc96
debug log statements, FileCacheDir (not yet used)
2023-11-29 19:28:32 -05:00
Brandon Thomas
f2e75f8637
rename files across fs devices
2023-11-29 18:46:00 -05:00
Brandon Thomas
f48cbb7978
fix
2023-11-29 18:16:45 -05:00
Brandon Thomas
edd5cd6156
Merge pull request #179 from storytold/brandon-fix-job-pathing
...
Brandon fix job pathing
2023-11-29 17:49:39 -05:00
Brandon Thomas
37c016cecb
"semi persistent dir" needs cleanup, this is confusing
2023-11-29 17:48:29 -05:00
Brandon Thomas
1a3e111dd6
Fix job pathing for outage and to make easier to manage
2023-11-29 17:30:03 -05:00
Brandon Thomas
0c456d957c
fix build errors
2023-11-29 15:46:43 -05:00
Brandon Thomas
85ecce7b38
comments
2023-11-29 03:07:07 -05:00
Brandon Thomas
2f1d682438
Merge pull request #176 from storytold/nov-29-mithoo
...
fail model deleted inference jobs
2023-11-29 02:44:38 -05:00
Brandon Thomas
c6fbfaa6ba
fix test failures and nits
2023-11-29 02:43:31 -05:00
Brandon Thomas
038401bff4
Merge pull request #177 from storytold/brandon-revert-sha2-bump
...
Revert "Bump sha2 from 0.9.9 to 0.10.8"
2023-11-29 02:29:16 -05:00
Brandon Thomas
e1c7231d96
Revert "Bump sha2 from 0.9.9 to 0.10.8"
...
This reverts commit 951afc2e5d .
2023-11-29 02:28:51 -05:00
kasisnu
1e11fdb35d
fail model deleted inference jobs
2023-11-29 12:43:49 +05:30
Brandon Thomas
74c477b045
Merge pull request #169 from storytold/dependabot/cargo/sha2-0.10.8
...
Bump sha2 from 0.9.9 to 0.10.8
2023-11-28 21:37:50 -05:00
Brandon Thomas
042fa1574d
Merge pull request #168 from storytold/dependabot/cargo/time-0.3.30
...
Bump time from 0.2.27 to 0.3.30
2023-11-28 21:37:26 -05:00
Brandon Thomas
4387e6326f
LFU cache in TT2 inference-job
2023-11-28 17:47:46 -05:00
Brandon Thomas
3ad2b744b7
test comment out Dockerfile /etc/ssl copy
2023-11-28 15:42:24 -05:00
Brandon Thomas
8bf85b637b
notes on dependencies
2023-11-28 15:40:26 -05:00
Brandon Thomas
50c3b5ed65
codegen db
2023-11-28 15:23:43 -05:00
Brandon Thomas
df15395bf7
fix build error
2023-11-28 15:08:39 -05:00
Brandon Thomas
5666d58da0
fix SSL problem?
2023-11-28 14:54:53 -05:00
dependabot[bot]
0a85e9c581
Bump time from 0.2.27 to 0.3.30
...
Bumps [time](https://github.com/time-rs/time ) from 0.2.27 to 0.3.30.
- [Release notes](https://github.com/time-rs/time/releases )
- [Changelog](https://github.com/time-rs/time/blob/main/CHANGELOG.md )
- [Commits](https://github.com/time-rs/time/compare/v0.2.27...v0.3.30 )
---
updated-dependencies:
- dependency-name: time
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-28 16:45:21 +00:00
ArEnSc
bd0ce25d94
Merge pull request #151 from storytold/feature/weights_queries
...
Feature/weights queries
2023-11-28 11:43:00 -05:00
ArEnSc
9f2335bfba
Merge branch 'master' into feature/weights_queries
2023-11-28 11:30:22 -05:00
Brandon Thomas
63eca62f1d
ssl to GCS broken in production, maybe this fixes?
2023-11-28 11:01:36 -05:00
Brandon Thomas
2808d20a35
fix wrong cleanup
2023-11-28 08:43:00 -05:00
Brandon Thomas
2d67947479
comment
2023-11-28 08:39:54 -05:00
Brandon Thomas
9722a34c8b
extra care to delete temp directories
2023-11-28 08:37:08 -05:00
Brandon Thomas
643dffc08c
scoped TempDir
2023-11-28 08:23:43 -05:00
Brandon Thomas
1433eca29a
queue stats for inference-job's tacotron2
2023-11-28 07:27:26 -05:00
Brandon Thomas
8176f0d6bd
fix lints
2023-11-28 06:26:17 -05:00
Brandon Thomas
2cfcbf8a75
db codegen + fix build errors
2023-11-28 06:19:37 -05:00
Brandon Thomas
fb9a9b75bf
Merge pull request #171 from storytold/brandon-tts-on-inference-job
...
tts-inference-job --> inference-job
2023-11-28 05:51:58 -05:00
Brandon Thomas
2a1675d865
formatting
2023-11-28 05:42:50 -05:00
Brandon Thomas
f672df7386
add TT2 HTTP sidecar health checking (hacky)
2023-11-28 05:11:43 -05:00
Brandon Thomas
59fc891ce4
filter out certain model types (so we don't leak to competitors)
2023-11-28 02:59:01 -05:00
Brandon Thomas
739f234ac3
emulate TTS Results in media file pages
2023-11-28 02:42:55 -05:00
Michael Chung
8303066c38
Added serial test to run the database tests in serial, prevent failing when running the suite.
2023-11-28 00:16:44 -05:00
Michael Chung
5feb500b5e
unit test for paging
2023-11-27 23:16:43 -05:00
Brandon Thomas
626157b615
emulate TTS inference job status checking for generic jobs
2023-11-27 22:19:27 -05:00
Brandon Thomas
7f3ccdc53d
cleanup dependency checking
2023-11-27 21:22:27 -05:00
Brandon Thomas
cc1d7f6de1
theoretically TTS HTTP works with inference-job
2023-11-27 20:55:13 -05:00
Brandon Thomas
3d4a870190
streamline inference-job tt2
2023-11-27 20:55:13 -05:00
Brandon Thomas
824d113dfc
port some dependencies of tts-inference-job to inference-job
2023-11-27 20:55:13 -05:00
Brandon Thomas
eaadc8242d
remove (unused) tts-inference-job shell out code
2023-11-27 20:55:13 -05:00
Brandon Thomas
bf5dddf6a9
Merge pull request #170 from storytold/brandon-seed-tt2-models
...
seed tool: TT2 models (with idempotency + early exit)
2023-11-27 20:50:31 -05:00
Brandon Thomas
22051f2dba
make idempotent
2023-11-27 20:42:37 -05:00
Brandon Thomas
d777346520
Update seed tool to seed TT2 models
2023-11-27 18:31:42 -05:00
dependabot[bot]
951afc2e5d
Bump sha2 from 0.9.9 to 0.10.8
...
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.9.9 to 0.10.8.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.9...sha2-v0.10.8 )
---
updated-dependencies:
- dependency-name: sha2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-27 22:32:08 +00:00
Michael Chung
d990fd4bfa
Merge branch 'feature/weights_queries' of https://github.com/storytold/storyteller-rust into feature/weights_queries
2023-11-27 12:12:02 -05:00
Michael Chung
6f5edf0c96
fixed issues with weights queries and the tests, tests slightly flaky need to have it delete the rows, and ensure it doesn't run in prod.
2023-11-27 12:09:34 -05:00
ArEnSc
b99756a7d1
Merge pull request #165 from storytold/nov-27-mithoo
...
query builder quickfix
2023-11-27 11:23:13 -05:00
kasisnu
dcbdaf9cd6
query builder quickfix
2023-11-27 17:47:55 +05:30
Michael Chung
8e4f419091
QiueryBuilder tests needed
2023-11-27 00:46:46 -05:00
Michael Chung
b779946fe7
Queries pass need just some mock data to test it in the test.rs
2023-11-26 15:29:57 -05:00
Michael Chung
a244e614cf
need to run tests on the query builder then can work on the rest of the code
2023-11-26 14:22:42 -05:00
Michael Chung
2e6708168b
building wip ... then test then endpoints probably need seed data for this that is a bit diverse.
2023-11-25 03:53:19 -05:00
Michael Chung
8c46f47352
queries building is wip.
2023-11-25 03:28:34 -05:00
Michael Chung
fdbf028743
test works query builder now.
2023-11-25 02:40:46 -05:00
Michael Chung
becf58a357
Time to test.
2023-11-25 01:51:02 -05:00
Michael Chung
a4c227a4ca
Fixes to the weights now need filter
2023-11-25 01:40:54 -05:00
Michael Chung
0e1e8a87f1
Mapping list_weights_by_user.rs done need filter and then test
2023-11-25 00:17:58 -05:00
Michael Chung
c9df278d40
weights_queries list weights by user more testing and implementation needed
2023-11-24 23:50:50 -05:00
Michael Chung
ddb35c5133
Added more data for seeding
...
Added to test lists need to get list_weights_by_user tested
2023-11-24 22:24:34 -05:00
Michael Chung
df3fc1bf51
more tests undelete and delete.
2023-11-24 00:35:43 -05:00
Michael Chung
21f2c3ac78
fixed weights queries get_weight hardcode transform
2023-11-24 00:19:21 -05:00
Michael Chung
be429017eb
Deleting weights from the database works for user
2023-11-23 23:34:14 -05:00
Michael Chung
2a623bd8eb
Ok just mapped this by hand, super dissapointed that I can't use the the proper way to do it for some unknown reason.
2023-11-23 22:46:28 -05:00
Michael Chung
8b2765ba65
Weight types is failing to serialize :S
2023-11-23 21:39:42 -05:00
Michael Chung
ccf1adae61
Add a test mod
2023-11-23 21:22:23 -05:00
Michael Chung
1a144ac8cf
Writing unit tests for the queries
2023-11-23 19:41:33 -05:00
Brandon Thomas
71581978ff
Merge pull request #162 from storytold/nov-21-mithoo
...
Bump actix & futures deps
2023-11-23 12:49:39 -05:00
Michael Chung
ce3aa6be74
model_weights delete need tests
2023-11-23 01:09:17 -05:00
Michael Chung
f63eb94ed7
update_weight needs testing
2023-11-23 00:46:11 -05:00
kasisnu
a987ae81cf
rebase codegen updates
2023-11-23 11:10:57 +05:30
kasisnu
684cd7df69
upgrade futures
2023-11-23 11:08:29 +05:30
kasisnu
703e297b94
easy bump actix deps
2023-11-23 11:08:29 +05:30
Michael Chung
2e4e109065
Notes
2023-11-22 23:41:16 -05:00
Michael Chung
8481d37167
Fixed compile errors.
2023-11-22 23:25:19 -05:00
Michael Chung
5ed397af4e
WIP get and update gotta write unit tests, WIP do not review.
2023-11-22 23:05:25 -05:00
Michael Chung
ccbc89fd3e
Fix function name issues
2023-11-22 13:21:52 -05:00
Brandon Thomas
62ce6d5991
codegen db
2023-11-22 03:07:13 -05:00
Brandon Thomas
e27871bd7e
Mark everything about BucketPathUnifier as deprecated. It sucks.
2023-11-22 02:27:48 -05:00
Brandon Thomas
106e3badc1
Merge pull request #163 from storytold/brandon-inference-job-startup-cleanup
...
Scoped inference jobs shouldn't require all parameters
2023-11-22 02:21:55 -05:00
Brandon Thomas
bcc91080e6
reorganize dependencies
2023-11-22 02:20:11 -05:00
Brandon Thomas
9848688a69
make container startup easier to parse
2023-11-21 22:45:04 -05:00
Brandon Thomas
5e2f85964c
vits dependencies
2023-11-21 22:18:32 -05:00
Brandon Thomas
8c17cd4415
vall-e-x dependencies
2023-11-21 21:54:32 -05:00
Brandon Thomas
58ce32dcbb
tacotron2
2023-11-21 21:45:55 -05:00
Brandon Thomas
2856be7aa9
SadTalker dependencies
2023-11-21 21:34:32 -05:00
Brandon Thomas
a28ef00618
cleanup job stubs we never implemented
2023-11-21 21:24:18 -05:00
Brandon Thomas
4941278590
SVC simplification
2023-11-21 20:06:33 -05:00
Michael Chung
5893753e35
Weights operations
2023-11-21 19:34:26 -05:00
Brandon Thomas
31ee410ac0
Cleanup Inference Job startup
...
- Don't require all env vars for all job types
2023-11-21 18:47:24 -05:00
Brandon Thomas
c256b14fe5
Merge pull request #158 from storytold/dependabot/cargo/tempfile-3.8.1
...
Bump tempfile from 3.3.0 to 3.8.1
2023-11-21 18:07:46 -05:00
Brandon Thomas
a2bd688ec2
Merge pull request #150 from storytold/dependabot/cargo/rustix-0.37.27
...
Bump rustix from 0.37.13 to 0.37.27
2023-11-21 18:07:20 -05:00
Brandon Thomas
2410be28c1
Merge pull request #159 from storytold/dependabot/cargo/num-traits-0.2.17
...
Bump num-traits from 0.2.15 to 0.2.17
2023-11-21 18:07:00 -05:00
Brandon Thomas
a1191aa2c3
Merge pull request #95 from storytold/oct-12-mithoo
...
super basic favorites impl
2023-11-21 18:03:58 -05:00
Brandon Thomas
2c502359a4
user favorites, entity favorites, etc. + minor changes
2023-11-21 18:02:32 -05:00
kasisnu
18bd819da2
zsvoice & VC models can be favorited
2023-11-21 14:59:28 -05:00
kasisnu
2614ba5eb9
remove ip address fields, and be able to favorite media files
2023-11-21 14:59:28 -05:00
kasisnu
b2bdf16c1c
update postman collection w/favoritesc
2023-11-21 14:59:27 -05:00
kasisnu
b436b07955
super basic favorites impl
2023-11-21 14:59:27 -05:00
Brandon Thomas
5da5908bea
Merge pull request #109 from storytold/oct-19-mithoo
...
delete media files/basic update handler
2023-11-21 13:24:22 -05:00
Brandon Thomas
58ea502400
Delete/update tweaks
2023-11-21 13:22:59 -05:00
kasisnu
3ed1f36e36
rebase updates with sqlx codegen
2023-11-21 13:14:43 -05:00
kasisnu
f958667cc4
delete media files/basic update handler
2023-11-21 13:14:43 -05:00
Kasisnu
87202f3ba2
Merge pull request #161 from storytold/nov-21-mithoo
...
disable speedup experiments on main workflows
2023-11-21 18:38:22 +05:30
kasisnu
b59bdc1ed5
disable speedup experiments on main workflows
2023-11-21 18:37:54 +05:30
Kasisnu
b68c7f415f
Merge pull request #160 from storytold/nov-21-mithoo
...
add new workflow
2023-11-21 13:34:53 +05:30
kasisnu
a08ebffeba
add new workflow
2023-11-21 13:33:20 +05:30
dependabot[bot]
7893acce0f
Bump num-traits from 0.2.15 to 0.2.17
...
Bumps [num-traits](https://github.com/rust-num/num-traits ) from 0.2.15 to 0.2.17.
- [Changelog](https://github.com/rust-num/num-traits/blob/master/RELEASES.md )
- [Commits](https://github.com/rust-num/num-traits/compare/num-traits-0.2.15...num-traits-0.2.17 )
---
updated-dependencies:
- dependency-name: num-traits
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-20 22:34:28 +00:00
dependabot[bot]
5dd3f7bf20
Bump tempfile from 3.3.0 to 3.8.1
...
Bumps [tempfile](https://github.com/Stebalien/tempfile ) from 3.3.0 to 3.8.1.
- [Changelog](https://github.com/Stebalien/tempfile/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Stebalien/tempfile/commits )
---
updated-dependencies:
- dependency-name: tempfile
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-20 22:33:55 +00:00
Kasisnu
f8a3a3b721
Merge pull request #157 from storytold/nov-20-mithoo
...
gpu build: copy result bins from updated directories
2023-11-20 15:47:35 +05:30
kasisnu
5895dc0b1f
gpu build: copy result bins from updated directories
2023-11-20 15:47:15 +05:30
kasisnu
75e19113da
x86_64-unknown-linux-musl -> x86_64-unknown-linux-gnu
2023-11-20 15:38:14 +05:30
Kasisnu
a7dcdf19ed
Merge pull request #156 from storytold/nov-20-mithoo
...
add --target=x86_64-unknown-linux-musl explicitly
2023-11-20 15:27:56 +05:30
kasisnu
8e415770fb
Merge remote-tracking branch 'origin/master' into nov-20-mithoo
2023-11-20 15:26:46 +05:30
kasisnu
28d64f29e2
sadpanda
2023-11-20 15:26:17 +05:30
Kasisnu
9da6be3320
Merge pull request #155 from storytold/nov-20-mithoo
...
statically build gpu binaries
2023-11-20 15:20:28 +05:30
kasisnu
49cec49844
statically build gpu binaries
2023-11-20 15:19:27 +05:30
Brandon Thomas
a2354cd64c
install rsync in containers (lazy, fix this)
...
This was a lazy way to add rsync into the containers to enable easy
copying of files + logging. This is not the ideal way to do this.
2023-11-20 01:20:09 -05:00
Kasisnu
809dabd253
Merge pull request #154 from storytold/nov-20-mithoo
...
trailing slash
2023-11-20 11:22:11 +05:30
kasisnu
0470811bb4
trailing slash
2023-11-20 11:21:50 +05:30
Kasisnu
fecb671400
Merge pull request #153 from storytold/nov-20-mithoo
...
sqlx codegen
2023-11-20 11:12:50 +05:30
kasisnu
6d82cb9de6
updated dockerfiles for sqlx codegen
2023-11-20 11:11:44 +05:30
kasisnu
0fdacfe295
sqlx codegen
2023-11-20 10:55:43 +05:30
Brandon Thomas
6a255330b4
Merge pull request #152 from storytold/brandon-rustls
...
Switch from native TLS to rustls
2023-11-20 00:10:20 -05:00
Brandon Thomas
e64fcab028
Switch from native TLS to rustls
...
This should make for smaller and simpler binaries.
2023-11-20 00:06:15 -05:00
Michael Chung
6026748563
Seeding Weights probably actually need real weights
2023-11-19 23:36:59 -05:00
dependabot[bot]
6cd48d2f5b
Bump rustix from 0.37.13 to 0.37.27
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.37.13 to 0.37.27.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.37.13...v0.37.27 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-20 04:34:25 +00:00
Brandon Thomas
b36283c76e
Merge pull request #149 from storytold/brandon-upgrade-sqlx-0.7.2
...
Upgrade sqlx to latest (0.7.2)
2023-11-19 23:32:22 -05:00
Brandon Thomas
bd4644098f
Upgrade sqlx to latest (0.7.2)
...
Hypothetically this unblocks native rustls over IP address. If so, we
can drop native OpenSSL and Ubuntu packages and make a much simpler
build.
See this issue:
https://github.com/launchbadge/sqlx/issues/1095#issuecomment-798050828
Had to deal with a few migration issues,
- changes to transactor types:
https://github.com/launchbadge/sqlx/issues/2606
- changes to sqlx_core that impacted our serialization/deserialization macros
2023-11-19 23:25:52 -05:00
Brandon Thomas
831b0eda29
Don't need this - let's invert the pod in control
2023-11-18 23:47:52 -05:00
Michael Chung
bffe8d39ae
model_weights/create_weight.rs being worked on
2023-11-18 00:44:41 -05:00
Michael Chung
c36ca5e73c
create model_weights
2023-11-17 23:59:53 -05:00
Michael Chung
55344fc6dd
Model Weight Queries has to be worked on categories and types tests written.
2023-11-17 23:39:55 -05:00
Brandon Thomas
0a9803af83
PLEAAASE BUILD
2023-11-17 11:29:27 -05:00
Brandon Thomas
0952d16a86
-y flag ?
2023-11-17 11:08:43 -05:00
Brandon Thomas
2ed43572e0
maybe patch 3.8 logger too
2023-11-17 10:34:16 -05:00
Brandon Thomas
72e67ed198
really install deadsnakes
2023-11-17 10:21:18 -05:00
Brandon Thomas
66774b0d31
python3.8 (this should only be temporary)
2023-11-17 10:14:04 -05:00
Brandon Thomas
d54cd75dec
unblock route
2023-11-17 08:48:13 -05:00
Brandon Thomas
23293e973f
codegen db
2023-11-17 03:42:01 -05:00
Brandon Thomas
5bb32d0adb
record millis and encoding
2023-11-17 03:16:40 -05:00
Brandon Thomas
d123a73069
confirm email when password reset
2023-11-17 02:48:24 -05:00
Brandon Thomas
f978c1f4cc
propagate avt to zero shot tts
2023-11-17 02:39:55 -05:00
Brandon Thomas
9d38440ae4
rename handler
2023-11-17 01:52:10 -05:00
Brandon Thomas
4530083333
more foreign key and field completion for samples
2023-11-17 01:49:03 -05:00
Brandon Thomas
23584b4462
Merge pull request #148 from storytold/brandon-vallex-pathing
...
Fix vallex pathing
2023-11-16 21:03:50 -05:00
Brandon Thomas
762cf2d0b4
pathing works
2023-11-16 21:02:54 -05:00
Brandon Thomas
7a4c035960
upload of weights works
2023-11-16 20:32:19 -05:00
Brandon Thomas
cd8ca0092b
modify bucket pathing
2023-11-16 20:07:14 -05:00
Brandon Thomas
c920ae5286
Merge pull request #147 from storytold/bt-split-vallex-to-files
...
split vallex tts inference + embedding creation
2023-11-16 19:06:55 -05:00
Brandon Thomas
61bb4162a3
split vallex tts inference + embedding creation
2023-11-16 19:06:16 -05:00
Brandon Thomas
a1c7db19e3
Merge pull request #146 from storytold/bt-better-error-logging-vallex
...
better error logging, pathing
2023-11-16 18:53:41 -05:00
Brandon Thomas
e6690fa133
better error logging, pathing
2023-11-16 18:52:56 -05:00
Brandon Thomas
c22f7fe654
Merge pull request #138 from storytold/dependabot/cargo/magic-crypt-3.1.13
...
Bump magic-crypt from 3.1.8 to 3.1.13
2023-11-16 17:56:54 -05:00
Brandon Thomas
bc94582138
Merge pull request #140 from storytold/dependabot/cargo/strum-0.25.0
...
Bump strum from 0.24.1 to 0.25.0
2023-11-16 17:56:18 -05:00
Brandon Thomas
b3226b04cb
Merge pull request #139 from storytold/dependabot/cargo/serde_json-1.0.108
...
Bump serde_json from 1.0.91 to 1.0.108
2023-11-16 17:56:05 -05:00
Michael Chung
afc0e27fb4
Made updates to the seed and the docs to reflect the new seed files.
2023-11-16 16:07:50 -05:00
Brandon Thomas
f338d57ef5
Merge pull request #145 from storytold/bt-zs-inference-cleanup
...
voice designer inference job cleanup
2023-11-16 15:01:26 -05:00
Brandon Thomas
419c202ec9
voice designer inference job cleanup
...
- paths were different between upload, inference, and seed tool
- errors aren't being appropriately handled (and there's still work to
do here)
2023-11-16 05:10:30 -05:00
dependabot[bot]
59c19b2927
Bump strum from 0.24.1 to 0.25.0
...
Bumps [strum](https://github.com/Peternator7/strum ) from 0.24.1 to 0.25.0.
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Peternator7/strum/commits )
---
updated-dependencies:
- dependency-name: strum
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-16 06:18:28 +00:00
dependabot[bot]
3adf92d4e5
Bump serde_json from 1.0.91 to 1.0.108
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.91 to 1.0.108.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.91...v1.0.108 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-16 06:17:36 +00:00
Brandon Thomas
04e2605240
fixup lint / test failures
2023-11-16 01:16:09 -05:00
Brandon Thomas
6186dcd89d
analytics on password resets
2023-11-16 01:06:03 -05:00
Brandon Thomas
0f3586746e
committing secrets is a sin
2023-11-16 00:45:47 -05:00
Brandon Thomas
f84c31de5b
success response fields
2023-11-16 00:03:01 -05:00
Brandon Thomas
a19cafbae0
parameterize SMTP account
2023-11-15 23:55:34 -05:00
Brandon Thomas
b45afab5ea
stupid fix
2023-11-15 23:18:41 -05:00
Brandon Thomas
6d24b4b49b
codegen db
2023-11-15 22:47:20 -05:00
Brandon Thomas
f9704f0da4
Merge pull request #144 from storytold/brandon-email-job
...
email-job
2023-11-15 22:34:43 -05:00
Brandon Thomas
c7c7c5b798
email-job
2023-11-15 22:31:18 -05:00
Brandon Thomas
462ed87a7b
Merge pull request #132 from storytold/brandon-model-weights
...
WIP / DNM - model_weights
2023-11-15 21:03:02 -05:00
Brandon Thomas
170f6772d7
rename migrations for better operational sequencing
2023-11-15 21:02:11 -05:00
Brandon Thomas
2b884ebe51
Move metadata into polymorphic join tables
2023-11-15 21:00:41 -05:00
Brandon Thomas
fec587d81e
"model_weights" to replace all of the various weights tables
2023-11-15 21:00:39 -05:00
dependabot[bot]
4aec1a2298
Bump magic-crypt from 3.1.8 to 3.1.13
...
Bumps [magic-crypt](https://github.com/magiclen/rust-magiccrypt ) from 3.1.8 to 3.1.13.
- [Commits](https://github.com/magiclen/rust-magiccrypt/compare/v3.1.8...v3.1.13 )
---
updated-dependencies:
- dependency-name: magic-crypt
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-16 01:31:31 +00:00
Brandon Thomas
1e3117789e
Merge pull request #143 from storytold/nov-15-mithoo
...
build fix, get endpoints for zs datasets/voices
2023-11-15 20:30:11 -05:00
kasisnu
a18ebc4db3
get endpoints for zs datasets & voices
2023-11-15 14:26:57 +05:30
kasisnu
6cc75df103
Merge remote-tracking branch 'origin/speedup-experiments' into nov-15-mithoo
2023-11-15 11:19:45 +05:30
kasisnu
297ce4e0ad
add hakari dep to dockerfile
2023-11-14 12:46:43 +05:30
kasisnu
235c0d6754
fix missing deps
2023-11-14 12:42:28 +05:30
Kasisnu
8cd8f45b6c
Merge pull request #142 from storytold/nov-12-mithoo
...
removing some unused creates
2023-11-14 12:37:04 +05:30
kasisnu
ee0526f499
add a second branch to test speedups
2023-11-14 12:35:50 +05:30
kasisnu
d84e497131
hakari deps
2023-11-14 12:32:54 +05:30
kasisnu
2eb5635c58
removing some unused creates
2023-11-14 12:31:37 +05:30
Brandon Thomas
dd3c87b712
don't leak accounts
2023-11-12 07:02:39 -05:00
Brandon Thomas
7dc7afd244
environmental reset link
2023-11-12 05:16:53 -05:00
Brandon Thomas
f1d3566f30
login after password reset
2023-11-12 04:24:47 -05:00
Brandon Thomas
3852851f65
'success' fields, cleanup
2023-11-12 02:52:26 -05:00
Brandon Thomas
bdd24c47fa
codegen db
2023-11-12 02:36:29 -05:00
Brandon Thomas
a31a72abb7
Merge pull request #137 from storytold/brandon-jake-password-reset
...
password reset
2023-11-12 02:27:56 -05:00
Brandon Thomas
34c90becbb
schema migrations for password reset
2023-11-12 02:26:38 -05:00
Brandon Thomas
a69d0f7b9a
redemption works
2023-11-11 19:56:23 -05:00
Brandon Thomas
e068af0e1c
wip redemption
2023-11-11 16:23:30 -05:00
Brandon Thomas
c6a111bb4c
smtp wired up
2023-11-11 14:53:58 -05:00
Brandon Thomas
9ce771f571
fix crockford-encoded entropy
2023-11-10 16:27:30 -05:00
Jacob Conley
5892fb1f14
Fixed implementation up to the point of sending the email
2023-11-10 16:14:24 -05:00
Jacob Conley
6bbf8a9b01
Changed e-mail library; still only partially implemented
2023-11-10 16:14:21 -05:00
Jacob Conley
16d6542911
Beginning password reset implementation
...
- Email send is not implemented yet
- All of this is still untested, clearly
2023-11-10 16:13:58 -05:00
Jacob Conley
1cc3c5eee4
Update more crockford_deprecated stuff for real this time
2023-11-10 16:12:42 -05:00
Jacob Conley
054d7db0a9
Update crockford_deprecated references
2023-11-10 16:12:41 -05:00
Jacob Conley
927337331e
Rename crockford crate to crockford_deprecated - Gotta update references
2023-11-10 16:12:41 -05:00
Kasisnu
50780926fb
Merge pull request #136 from storytold/nov-10-mithoo
...
fix various stripe handler errors :(
2023-11-10 15:05:33 +05:30
kasisnu
2ebd6dc634
fix various stripe handler errors :(
2023-11-10 15:05:02 +05:30
Kasisnu
c5d5a4ba08
Merge pull request #135 from storytold/nov-10-mithoo
...
feat: report errors to stripe
2023-11-10 13:59:40 +05:30
kasisnu
797332b887
feat: report errors to stripe
2023-11-10 13:59:19 +05:30
Kasisnu
30d71ad605
Merge pull request #134 from storytold/nov-10-mithoo
...
audio mp4 uploads on ios
2023-11-10 13:47:15 +05:30
kasisnu
889121a818
audio mp4 uploads on ios
2023-11-10 13:46:39 +05:30
Brandon Thomas
293f531a79
Merge pull request #133 from storytold/lru-delete-models
...
Delete models from AWS EFS host
2023-11-10 00:36:21 -05:00
Brandon Thomas
fc344557be
Delete models from AWS EFS host
2023-11-10 00:35:36 -05:00
Brandon Thomas
a34785c308
Merge pull request #128 from storytold/dependabot/cargo/hyper-0.14.24
...
Bump hyper from 0.13.10 to 0.14.24
2023-11-09 13:44:41 -05:00
Brandon Thomas
7d6aec158c
Merge pull request #114 from storytold/dependabot/cargo/derive_more-0.99.17
...
Bump derive_more from 0.99.14 to 0.99.17
2023-11-09 13:42:14 -05:00
Brandon Thomas
861faafe60
Merge pull request #127 from storytold/dependabot/cargo/subprocess-0.2.9
...
Bump subprocess from 0.2.7 to 0.2.9
2023-11-09 13:42:05 -05:00
Brandon Thomas
5240d3cde5
Merge pull request #129 from storytold/dependabot/cargo/futures-util-0.3.29
...
Bump futures-util from 0.3.28 to 0.3.29
2023-11-09 13:41:56 -05:00
Brandon Thomas
8b962dcf6d
notes on vocoder_models table
2023-11-09 00:45:30 -05:00
dependabot[bot]
e2c3aedfb8
Bump hyper from 0.13.10 to 0.14.24
...
Bumps [hyper](https://github.com/hyperium/hyper ) from 0.13.10 to 0.14.24.
- [Release notes](https://github.com/hyperium/hyper/releases )
- [Changelog](https://github.com/hyperium/hyper/blob/v0.14.24/CHANGELOG.md )
- [Commits](https://github.com/hyperium/hyper/compare/v0.13.10...v0.14.24 )
---
updated-dependencies:
- dependency-name: hyper
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-08 17:31:45 +00:00
dependabot[bot]
e9605ea6af
Bump futures-util from 0.3.28 to 0.3.29
...
Bumps [futures-util](https://github.com/rust-lang/futures-rs ) from 0.3.28 to 0.3.29.
- [Release notes](https://github.com/rust-lang/futures-rs/releases )
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.28...0.3.29 )
---
updated-dependencies:
- dependency-name: futures-util
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-08 17:31:22 +00:00
Brandon Thomas
c6c708827b
Merge pull request #131 from storytold/nov-08-mithoo
...
bump async-stripe, dealing with webhook handler failures/updates
2023-11-08 12:29:03 -05:00
kasisnu
c9b3ce06d6
bump async-stripe, dealing with webhook handler failures/updates
2023-11-08 15:17:06 +05:30
Kasisnu
e4faf58990
Merge pull request #130 from storytold/nov-08-mithoo
...
iphone audio mimetype
2023-11-08 12:08:58 +05:30
kasisnu
d77c5e1885
iphone audio mimetype
2023-11-08 12:08:17 +05:30
Brandon Thomas
4930629a3a
fix lint and test failures
2023-11-07 22:33:38 -05:00
Brandon Thomas
331a0ce518
codegen db
2023-11-07 21:55:31 -05:00
Brandon Thomas
7aaa70bb31
more voice takedowns
2023-11-07 21:41:02 -05:00
Brandon Thomas
81d54291d1
Add README notes for Mac; streamline README
2023-11-02 01:14:48 -04:00
Brandon Thomas
77a2cc3439
dynamically flag off voice designer in production
2023-11-01 05:47:59 -04:00
Brandon Thomas
2882128a5c
todo
2023-11-01 04:38:06 -04:00
Brandon Thomas
0150715d63
setup for Windows Subsystem for Linux
2023-11-01 02:38:08 -04:00
Brandon Thomas
d63f5a8728
reorganize readme
2023-10-31 22:49:23 -04:00
dependabot[bot]
dcd77e53aa
Bump subprocess from 0.2.7 to 0.2.9
...
Bumps [subprocess](https://github.com/hniksic/rust-subprocess ) from 0.2.7 to 0.2.9.
- [Commits](https://github.com/hniksic/rust-subprocess/compare/release/0.2.7...release/0.2.9 )
---
updated-dependencies:
- dependency-name: subprocess
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-30 23:12:08 +00:00
Brandon Thomas
10ce570aa9
Merge pull request #126 from storytold/brandon-zs-endpoint-refinement
...
Brandon zs endpoint refinement
2023-10-30 18:29:43 -04:00
Brandon Thomas
fa3244c72b
fix iPhone audio/mp4 bug
2023-10-30 15:12:42 -04:00
Brandon Thomas
7a6a3840c3
return more fields on "list all voices"
2023-10-30 04:26:39 -04:00
Brandon Thomas
30760e29d6
list datasets by session handler; more cleanup
2023-10-30 04:14:55 -04:00
Brandon Thomas
3c025c506e
add "list voices by session" endpoint; misc cleanup
2023-10-30 03:41:56 -04:00
Brandon Thomas
8dd5661923
remove more
2023-10-29 12:39:35 -04:00
Brandon Thomas
0bcdaa0d2d
missed one
2023-10-29 12:35:20 -04:00
Brandon Thomas
c5efc9e0c8
RVC takedown requests
2023-10-29 12:33:45 -04:00
Brandon Thomas
b8c85b7e91
minor tweak to threading
2023-10-28 20:52:30 -04:00
Brandon Thomas
29e556c311
rename with kebob-case
2023-10-28 20:27:02 -04:00
Brandon Thomas
dc735c01a0
rust 1.66 -> 1.73 (required update)
2023-10-27 06:13:06 -04:00
Brandon Thomas
7d66279d70
fix nits
2023-10-27 06:09:21 -04:00
Brandon Thomas
d6de7acc5c
codegen db
2023-10-27 05:58:34 -04:00
Brandon Thomas
5da6cee74c
Merge pull request #124 from storytold/brandon-elasticsearch
...
Introduce elasticsearch database + tools
2023-10-27 05:56:20 -04:00
Brandon Thomas
e4607fe658
Introduce elasticsearch database + tools
2023-10-27 05:56:00 -04:00
Brandon Thomas
4def45d769
Merge pull request #123 from storytold/brandon-revert-sha2-upgrade
...
Revert "Bump sha2 from 0.9.5 to 0.10.5"
2023-10-26 00:01:30 -04:00
Brandon Thomas
b6f7f50b16
Revert "Bump sha2 from 0.9.5 to 0.10.5"
...
This reverts commit b9667e2540 .
2023-10-25 23:52:40 -04:00
Brandon Thomas
8af1a2da47
Merge pull request #115 from storytold/dependabot/cargo/sha2-0.10.5
...
Bump sha2 from 0.9.5 to 0.10.5
2023-10-25 23:50:32 -04:00
dependabot[bot]
995c912e94
Bump derive_more from 0.99.14 to 0.99.17
...
Bumps [derive_more](https://github.com/JelteF/derive_more ) from 0.99.14 to 0.99.17.
- [Release notes](https://github.com/JelteF/derive_more/releases )
- [Changelog](https://github.com/JelteF/derive_more/blob/master/CHANGELOG.md )
- [Commits](https://github.com/JelteF/derive_more/compare/v0.99.14...v0.99.17 )
---
updated-dependencies:
- dependency-name: derive_more
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-26 03:50:14 +00:00
Brandon Thomas
c018001693
Merge pull request #116 from storytold/dependabot/cargo/pulldown-cmark-0.9.3
...
Bump pulldown-cmark from 0.8.0 to 0.9.3
2023-10-25 23:48:38 -04:00
Brandon Thomas
3f54396ef4
Merge pull request #118 from storytold/dependabot/cargo/actix-http-3.4.0
...
Bump actix-http from 3.3.0 to 3.4.0
2023-10-25 23:48:14 -04:00
Brandon Thomas
85eed593d0
Merge pull request #122 from storytold/voice-designer-concrete-types
...
more concrete types for "enum"-like fields, remove unnecessary updates
2023-10-25 23:47:21 -04:00
Brandon Thomas
50a0cb298d
more concrete types for "enum"-like fields, remove unnecessary updates
2023-10-25 23:39:42 -04:00
Brandon Thomas
b11ad51d8e
rename enum serialization
2023-10-25 17:01:17 -04:00
Brandon Thomas
b0aae47328
rename some IdCategory enum values (not serializations)
2023-10-25 16:58:45 -04:00
Brandon Thomas
a6c4c10a9a
fix tests and lints
2023-10-25 16:46:19 -04:00
ArEnSc
7b31887891
Merge pull request #94 from storytold/feature/enqueue_tts_request
...
Feature/enqueue tts request
2023-10-25 11:58:31 -04:00
Michael Chung
8a5e4538a0
All good! going to merge now.
2023-10-25 11:32:22 -04:00
Brandon Thomas
37129a6d01
better documentation
2023-10-25 04:04:51 -04:00
Brandon Thomas
7731c534a3
restructure tokens package to organize prefixes
...
Tests enforce the new style, which wasn't possible before
2023-10-25 03:57:19 -04:00
dependabot[bot]
b9667e2540
Bump sha2 from 0.9.5 to 0.10.5
...
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.9.5 to 0.10.5.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.5...sha2-v0.10.5 )
---
updated-dependencies:
- dependency-name: sha2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-25 07:03:42 +00:00
Brandon Thomas
9aeca4aa90
Finally 'Tokens::' methods are dead!
2023-10-25 03:02:14 -04:00
Brandon Thomas
f40a292b1e
todo
2023-10-25 00:59:27 -04:00
Brandon Thomas
d90df6f8b8
change billing token to typed token
2023-10-25 00:55:54 -04:00
Brandon Thomas
92c76d2bb9
get rid of more legacy tokens
2023-10-25 00:49:12 -04:00
Brandon Thomas
9b5bb16358
continue getting rid of Token in the mysql package
2023-10-25 00:14:11 -04:00
Brandon Thomas
03135fa781
investigate use of face animator
2023-10-24 23:48:13 -04:00
Michael Chung
3f70ca72dd
Dev environment
...
Fixed various code problems, going to merge soon.
2023-10-24 13:09:36 -04:00
Michael Chung
d8a4b6c735
Get everything to build again we have to merge soon.
2023-10-24 11:26:12 -04:00
Michael Chung
48ed6d118c
Merge issues with VSCode? this is strange ....
2023-10-24 11:15:31 -04:00
Michael Chung
4c3ac3edda
Merge branch 'master' into feature/enqueue_tts_request
2023-10-24 10:20:37 -04:00
Brandon Thomas
dae5764658
codegen queries
2023-10-24 05:40:33 -04:00
Brandon Thomas
98547df063
propagate avt from jobs to media_files
2023-10-24 05:12:42 -04:00
Brandon Thomas
9c856235fc
write avt cookie token to inference jobs
2023-10-24 05:04:00 -04:00
Brandon Thomas
205f6de1b2
fix lint failures
2023-10-24 04:20:38 -04:00
Brandon Thomas
a9fa45575e
additional comment
2023-10-24 04:07:02 -04:00
Brandon Thomas
1b77974a0e
change user token prefix
2023-10-24 04:06:33 -04:00
Brandon Thomas
724ae2570e
How did this ever work!?
2023-10-24 03:56:38 -04:00
Brandon Thomas
dc7b5b7e60
Merge pull request #120 from storytold/echelon-terminate-job-endpoint
...
endpoint to terminate jobs
2023-10-24 02:41:03 -04:00
Brandon Thomas
3259433717
endpoint to terminate jobs
2023-10-24 02:40:00 -04:00
Brandon Thomas
bc5d84a306
use the new job status enum
2023-10-24 01:22:48 -04:00
Brandon Thomas
2357f00944
Merge pull request #119 from storytold/echelon-job-system-new-states
...
Introduce two new job status types to generic inference jobs
2023-10-24 01:08:15 -04:00
Brandon Thomas
24127f20e4
Introduce two new job status types to generic inference jobs
2023-10-24 01:06:14 -04:00
Brandon Thomas
4c8f14d4d5
Migration to make password_resets.ip_address_redemption nullable
2023-10-23 22:11:26 -04:00
Brandon Thomas
e14440ba02
undo edit to previous migration (should be harmless in prod)
2023-10-23 22:05:11 -04:00
Michael Chung
7295a3295f
Fix prefixes for create and inference
2023-10-23 22:03:37 -04:00
Michael Chung
10176079c7
remove variables not used
2023-10-23 21:59:26 -04:00
Michael Chung
8999a80e92
Change root ml dir
2023-10-23 21:34:58 -04:00
Michael Chung
41b07049ff
Remove comments
2023-10-23 21:29:41 -04:00
Michael Chung
b45f6ed691
Restore storyteller rust root for dev_database_seed
2023-10-23 21:25:04 -04:00
Michael Chung
9d16eb05c1
Fix data seed env-secrets path.
2023-10-23 21:13:27 -04:00
Michael Chung
b414540251
Fixing issue with the origin model type along side tests.
2023-10-23 21:11:00 -04:00
Michael Chung
2949456adc
Restore bad merge on id_category.rs
2023-10-23 21:07:35 -04:00
dependabot[bot]
02d06df0e2
Bump actix-http from 3.3.0 to 3.4.0
...
Bumps [actix-http](https://github.com/actix/actix-web ) from 3.3.0 to 3.4.0.
- [Release notes](https://github.com/actix/actix-web/releases )
- [Changelog](https://github.com/actix/actix-web/blob/master/CHANGES.md )
- [Commits](https://github.com/actix/actix-web/compare/web-v3.3.0...http-v3.4.0 )
---
updated-dependencies:
- dependency-name: actix-http
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-23 22:31:41 +00:00
dependabot[bot]
b89ef1fe20
Bump pulldown-cmark from 0.8.0 to 0.9.3
...
Bumps [pulldown-cmark](https://github.com/raphlinus/pulldown-cmark ) from 0.8.0 to 0.9.3.
- [Release notes](https://github.com/raphlinus/pulldown-cmark/releases )
- [Commits](https://github.com/raphlinus/pulldown-cmark/compare/v0.8.0...v0.9.3 )
---
updated-dependencies:
- dependency-name: pulldown-cmark
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-23 22:30:59 +00:00
Michael Chung
3a72292898
Some minor comment fix
2023-10-23 16:54:27 -04:00
Michael Chung
07c640ce84
Retest the endpoints with the correct credentials
...
One more integration test with multiple wav files.
2023-10-23 16:52:31 -04:00
Michael Chung
49a15fd1f1
Cleaning up some of the end points.
2023-10-23 16:22:37 -04:00
Michael Chung
3267f9949d
Added ip address and creator token.
2023-10-23 16:02:07 -04:00
Michael Chung
47df6930d2
Basically works well!
...
Few things to checkout.
2023-10-22 23:38:31 -04:00
Michael Chung
913d282d60
Fixed extensions on create
...
Checking whether media uploads.
2023-10-22 20:52:57 -04:00
Michael Chung
743934ff50
Need to do a clean up then check media upload and table
2023-10-22 20:36:32 -04:00
Michael Chung
bc209fe939
So the prefix wasn't populated in the seed I think!
2023-10-22 17:57:35 -04:00
Michael Chung
302975ddfd
Seeded db testing again
2023-10-22 11:57:29 -04:00
Michael Chung
d7664e8e1c
Merge branch 'master' into feature/enqueue_tts_request
2023-10-21 02:41:43 -04:00
Michael Chung
9f7fc09e9f
Builds testing.
2023-10-21 01:13:39 -04:00
Michael Chung
2686cb94e0
Testing create command now.
2023-10-21 00:28:11 -04:00
Michael Chung
fd7f1e1893
testing now.
2023-10-20 23:27:31 -04:00
Brandon Thomas
eb3499596e
always output stderr
2023-10-20 14:45:03 -04:00
Michael Chung
00bfdad3d0
Test pass!
2023-10-20 12:13:57 -04:00
Michael Chung
ff3821956a
Builds again
2023-10-20 11:43:16 -04:00
Michael Chung
a5a5f5473b
Testing!
2023-10-20 10:13:23 -04:00
Brandon Thomas
7c553ffcee
fix rvc jobs
2023-10-20 07:00:09 -04:00
Brandon Thomas
52f0b44c26
codegen db
2023-10-20 06:14:49 -04:00
Brandon Thomas
fbed7cd530
Merge pull request #113 from storytold/echelon-voice-conversion-media-files
...
voice conversion --> media files
2023-10-20 06:14:19 -04:00
Brandon Thomas
4ce8752a6a
codegen db
2023-10-20 06:12:41 -04:00
Brandon Thomas
3239e318b1
fix inference job status links
2023-10-20 05:37:51 -04:00
Brandon Thomas
471dcff697
RVC -> media_files
2023-10-20 05:14:00 -04:00
Brandon Thomas
2af57fcf3e
Write voice conversion results to media_files tables
2023-10-20 05:14:00 -04:00
Brandon Thomas
f2b0e77210
fix stupid "1" bug on generic jobs
2023-10-20 05:13:44 -04:00
Michael Chung
10c8bc1ef3
Just need to run inference and pass the insert the record and upload the voice once it infers.
...
Run the path test.
2023-10-20 01:46:13 -04:00
Brandon Thomas
35dfe6a7f2
fix lints
2023-10-20 01:09:56 -04:00
Brandon Thomas
48ecc44978
Merge pull request #112 from storytold/echelon-seed-samples
...
Update seed tool to seed and upload samples
2023-10-19 22:36:30 -04:00
Brandon Thomas
4f0e2d5f72
Update seed tool to seed and upload samples
2023-10-19 22:33:24 -04:00
Brandon Thomas
96c99fd102
Merge pull request #111 from storytold/echelon-media-file-upload-cli
...
CLI tool to upload media files and save them to the DB
2023-10-19 21:56:38 -04:00
Brandon Thomas
26794b3d2e
CLI tool to upload media files and save them to the DB
2023-10-19 21:52:32 -04:00
Michael Chung
c3a60ed8ab
Merge branch 'master' into feature/enqueue_tts_request
2023-10-19 20:12:40 -04:00
Michael Chung
13964901f0
update process job created a fork for creating voice
2023-10-19 19:19:53 -04:00
Brandon Thomas
593fb50fcb
Merge pull request #110 from storytold/echelon-list-dataset-samples
...
Enrich list dataset samples query + endpoint with bucket information
2023-10-19 18:24:39 -04:00
Brandon Thomas
fff71d7aa4
Enrich list dataset samples query + endpoint with bucket information
2023-10-19 18:18:35 -04:00
Michael Chung
57eecb3757
Creating the create voice job
2023-10-19 16:26:43 -04:00
Brandon Thomas
022aa523cb
fix cookie paths ?
2023-10-19 05:56:15 -04:00
Brandon Thomas
6d01506bd1
fix cookie path
2023-10-19 05:53:44 -04:00
Brandon Thomas
0cc3baee27
Merge pull request #108 from storytold/brandon-set-avt-cookie
...
Start setting AVT cookie on /v1/session endpoint
2023-10-19 05:06:00 -04:00
Brandon Thomas
d5b28d2d3e
Start setting AVT cookie on /v1/session endpoint
2023-10-19 04:24:50 -04:00
Brandon Thomas
d6a3d4887f
Merge pull request #107 from storytold/bt-revert-sha2-upgrade
...
Revert "Bump sha2 from 0.9.5 to 0.10.5"
2023-10-19 02:44:56 -04:00
Brandon Thomas
cce4f5f3b7
Revert "Bump sha2 from 0.9.5 to 0.10.5"
...
This reverts commit 59f7b6f732 .
2023-10-19 02:44:21 -04:00
Brandon Thomas
9123dbc3d9
Merge pull request #98 from storytold/dependabot/cargo/sha2-0.10.5
...
Bump sha2 from 0.9.5 to 0.10.5
2023-10-19 02:41:04 -04:00
Brandon Thomas
d43a747033
Merge pull request #100 from storytold/dependabot/cargo/rpassword-7.2.0
...
Bump rpassword from 5.0.1 to 7.2.0
2023-10-19 02:40:25 -04:00
Brandon Thomas
c3e5b42bf3
use JwtSigner for session cookie
2023-10-19 02:39:17 -04:00
Michael Chung
25cdbf2f1d
Adding create voice command
2023-10-19 02:09:16 -04:00
dependabot[bot]
59f7b6f732
Bump sha2 from 0.9.5 to 0.10.5
...
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.9.5 to 0.10.5.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.5...sha2-v0.10.5 )
---
updated-dependencies:
- dependency-name: sha2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-19 05:57:20 +00:00
dependabot[bot]
fe7251744f
Bump rpassword from 5.0.1 to 7.2.0
...
Bumps [rpassword](https://github.com/conradkleinespel/rpassword ) from 5.0.1 to 7.2.0.
- [Release notes](https://github.com/conradkleinespel/rpassword/releases )
- [Commits](https://github.com/conradkleinespel/rpassword/compare/v5.0.1...v7.2.0 )
---
updated-dependencies:
- dependency-name: rpassword
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-19 05:56:56 +00:00
Brandon Thomas
fdd60b436a
Merge pull request #99 from storytold/dependabot/cargo/scraper-0.17.1
...
Bump scraper from 0.14.0 to 0.17.1
2023-10-19 01:55:06 -04:00
Brandon Thomas
0836e88f4c
Merge pull request #101 from storytold/dependabot/cargo/diesel-2.1.3
...
Bump diesel from 1.4.6 to 2.1.3
2023-10-19 01:54:46 -04:00
Brandon Thomas
261978f763
Merge pull request #102 from storytold/dependabot/cargo/anyhow-1.0.75
...
Bump anyhow from 1.0.40 to 1.0.75
2023-10-19 01:53:55 -04:00
Brandon Thomas
d072e021d1
Merge pull request #106 from storytold/echelon-cookies
...
Cookie stuff - JWT signer, anonymous visitor cookies, etc.
2023-10-19 01:53:05 -04:00
Brandon Thomas
66442d9eda
Cookie stuff - JWT signer, anonymous visitor cookies, etc.
...
- JWT signer is reusable, tested
- AVT cookies improve the anonymous user experience and will help
internal analytics
2023-10-19 01:37:50 -04:00
Michael Chung
0f4cab9ca3
Added missing new file
2023-10-18 19:50:24 -04:00
Michael Chung
6de4d451ac
Fixed import issues
2023-10-18 19:50:07 -04:00
Michael Chung
9d4e426ace
It is now being tested then we work on the command side.
2023-10-18 18:02:30 -04:00
Michael Chung
bfb5103f46
Merge branch 'master' into feature/enqueue_tts_request
2023-10-18 13:37:23 -04:00
Michael Chung
3308c05836
Need to pull master
2023-10-18 13:26:19 -04:00
Brandon Thomas
5a539e589d
codegen db
2023-10-18 04:53:55 -04:00
Brandon Thomas
604c72179a
password_resets needs a unique index on (user, secret_key)
2023-10-18 02:22:39 -04:00
Michael Chung
be19eefa1a
Upload and create record and were good to do the other command and clean up.
2023-10-18 02:13:59 -04:00
Michael Chung
34e2b1e544
It works runs inference_job
...
Need to upload the file then create the record for download
2023-10-18 02:03:41 -04:00
Brandon Thomas
95152e9a88
fix replacement paths
2023-10-18 00:31:43 -04:00
Michael Chung
cbe8aaa1ba
More fixes
2023-10-18 00:04:33 -04:00
Michael Chung
11185584a7
Fixing typos and virtual env
2023-10-17 22:56:30 -04:00
Michael Chung
76559cf783
fix the env
2023-10-17 22:11:22 -04:00
Michael Chung
2e7bd622f3
fixed a typo
2023-10-17 22:06:42 -04:00
Michael Chung
68048659d4
Testing inference_job
2023-10-17 22:00:14 -04:00
Brandon Thomas
608e94a6a8
Merge pull request #105 from storytold/echelon-config-path-substitution
...
Substitute config absolute paths with magic substitution strings
2023-10-17 21:38:06 -04:00
Brandon Thomas
9e0bee8fba
Substitute config absolute paths with magic substitution strings
2023-10-17 21:37:20 -04:00
Brandon Thomas
dcec9b9e8a
Merge pull request #104 from storytold/echelon-storyteller-home
...
"storyteller root" directory in development
2023-10-17 21:12:51 -04:00
Brandon Thomas
3fc0f45942
"storyteller root" directory in development
2023-10-17 21:04:54 -04:00
Brandon Thomas
bfd325900f
Merge pull request #103 from storytold/echelon-better-envvars
...
Better env var support
2023-10-17 17:00:54 -04:00
Brandon Thomas
1ef7ae1009
Better env var support
2023-10-17 16:31:53 -04:00
Michael Chung
17d51f8d87
Merge branch 'master' into feature/enqueue_tts_request
2023-10-17 13:37:35 -04:00
Brandon Thomas
ca81d1b543
fix build / lint errors
2023-10-16 20:02:41 -04:00
dependabot[bot]
1de3e669d6
Bump anyhow from 1.0.40 to 1.0.75
...
Bumps [anyhow](https://github.com/dtolnay/anyhow ) from 1.0.40 to 1.0.75.
- [Release notes](https://github.com/dtolnay/anyhow/releases )
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.40...1.0.75 )
---
updated-dependencies:
- dependency-name: anyhow
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-16 22:18:42 +00:00
dependabot[bot]
ac39ac0a76
Bump diesel from 1.4.6 to 2.1.3
...
Bumps [diesel](https://github.com/diesel-rs/diesel ) from 1.4.6 to 2.1.3.
- [Release notes](https://github.com/diesel-rs/diesel/releases )
- [Changelog](https://github.com/diesel-rs/diesel/blob/v2.1.3/CHANGELOG.md )
- [Commits](https://github.com/diesel-rs/diesel/compare/v1.4.6...v2.1.3 )
---
updated-dependencies:
- dependency-name: diesel
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-16 22:18:25 +00:00
dependabot[bot]
f9caa7d836
Bump scraper from 0.14.0 to 0.17.1
...
Bumps [scraper](https://github.com/causal-agent/scraper ) from 0.14.0 to 0.17.1.
- [Release notes](https://github.com/causal-agent/scraper/releases )
- [Commits](https://github.com/causal-agent/scraper/compare/v0.14.0...v0.17.1 )
---
updated-dependencies:
- dependency-name: scraper
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-16 22:17:50 +00:00
Michael Chung
5f7a10a54c
Merge branch 'master' into feature/enqueue_tts_request
2023-10-16 09:34:46 -04:00
Brandon Thomas
e478c73ddf
Merge pull request #97 from storytold/echelon-sample-upload
...
Dataset sample upload (not yet tested, but compiles, and needs lots of cleanup)
2023-10-14 12:23:36 -04:00
Brandon Thomas
92676e842c
Dataset sample upload
2023-10-14 12:18:42 -04:00
Michael Chung
7eee225296
Builds again need to clearify what happened to the download function
2023-10-13 15:36:21 -04:00
Michael Chung
1319471c04
Merge branch 'master' into feature/enqueue_tts_request
2023-10-13 10:02:17 -04:00
Brandon Thomas
47e7269880
codegen db
2023-10-13 02:50:15 -04:00
Brandon Thomas
9b83caece1
Merge pull request #96 from storytold/echelon-get-media-file-endpoint
...
v1 of media_file GET endpoint.
2023-10-13 02:40:39 -04:00
Brandon Thomas
138057e105
v1 of media_file GET endpoint.
...
Media files are used for inference outputs, file uploads, Zero Shot
files, etc. We don't have any of the basic CRUD operations around them
yet, so this is a start.
This endpoint will need more metadata - moderation, file provenance,
file details, etc. But this will do for now.
2023-10-13 02:38:34 -04:00
Brandon Thomas
3e8b6f39fe
Merge branch 'master' into feature/enqueue_tts_request
2023-10-12 23:28:08 -04:00
Brandon Thomas
63b4a3180f
filter out sadtalker name
2023-10-12 06:22:39 -04:00
Brandon Thomas
6842794af6
another face detection failure
2023-10-12 06:15:43 -04:00
Brandon Thomas
a963e5146a
more instances of face detection failure
2023-10-12 05:33:56 -04:00
Brandon Thomas
eb65ed5fa8
re-codegen db
2023-10-12 03:52:12 -04:00
Brandon Thomas
f6989230be
write origin_product_category
2023-10-12 03:51:01 -04:00
Brandon Thomas
2d3f29139a
re-codegen db
2023-10-12 02:53:48 -04:00
Brandon Thomas
a059aa7271
fix lints
2023-10-12 02:08:13 -04:00
Brandon Thomas
8699a9e342
record and report frontend_failure_category
2023-10-12 02:04:29 -04:00
Brandon Thomas
48bf168d99
improve readability
2023-10-12 01:14:03 -04:00
Brandon Thomas
f1fd99be15
record frontend_failure_category, emit SadTalker errors
2023-10-12 01:03:36 -04:00
Michael Chung
a0b8849806
Trying to build again.
2023-10-12 00:56:50 -04:00
Brandon Thomas
49db299f96
enums for two new columns
2023-10-11 23:09:18 -04:00
Brandon Thomas
b1e87b7d90
two migrations (media_files, generic_inference_jobs)
...
- media_files.origin_product_category
- generic_inference_jobs.frontend_failure_category
2023-10-11 22:38:23 -04:00
Michael Chung
bb0a4958ef
Need to build and fix the container.
2023-10-11 18:19:40 -04:00
Brandon Thomas
4aacc23101
kill sadtalker jobs
2023-10-11 17:31:41 -04:00
Brandon Thomas
536307c162
analytics queries
2023-10-11 17:11:34 -04:00
Brandon Thomas
d5c86d1345
fix breakage due to s3 client upgrade (YOLO) + lint fixes
2023-10-11 16:53:37 -04:00
Brandon Thomas
1900a31541
Merge pull request #66 from storytold/dependabot/cargo/rust-s3-0.33.0
...
Bump rust-s3 from 0.32.3 to 0.33.0
2023-10-11 16:26:24 -04:00
Brandon Thomas
067538f1c2
Merge pull request #88 from storytold/oct-10-mithoo
...
use usernames to list datasets/voices & simple handler for listing samples
2023-10-11 16:19:21 -04:00
Michael Chung
a256681f6d
Merge branch 'master' into feature/enqueue_tts_request
2023-10-11 12:58:57 -04:00
kasisnu
03443be19c
inventory list voices with pagination
2023-10-11 16:52:37 +05:30
Michael Chung
ec03420efc
Fixed issue with typo in job.
...
Need to fix process job and run it.
2023-10-11 02:51:47 -04:00
Brandon Thomas
bfc8171fa7
additional safeguards
2023-10-11 00:02:36 -04:00
Brandon Thomas
248ee45d11
multithreaded
2023-10-10 23:49:43 -04:00
Brandon Thomas
97be5da1b5
Truncate bucket hash for seeded zero shot voice records
2023-10-10 22:06:16 -04:00
Brandon Thomas
d26902911f
Merge pull request #93 from storytold/feature/fix-database-seed-voice-embeddings
...
Fixed bucket hash issue
2023-10-10 22:00:27 -04:00
Michael Chung
0560a2d607
Fixed bucket hash issue
2023-10-10 20:34:27 -04:00
Michael Chung
264058ea87
Just a quick commit gotta modify the seeding script to get the bucket hashes for downloading
2023-10-10 20:20:56 -04:00
Brandon Thomas
b175cc0e65
cleanup more statuses
2023-10-10 19:24:07 -04:00
Brandon Thomas
ae781a3e37
rename to kubectl- to not collide with base tool in tab complete
2023-10-10 19:15:53 -04:00
Brandon Thomas
ee00fbe585
cleanup pods with these statuses
2023-10-10 19:12:39 -04:00
Brandon Thomas
82791ec39e
delete pods randomly
2023-10-10 18:51:35 -04:00
Brandon Thomas
b6bbc76b18
delete batches
2023-10-10 18:24:57 -04:00
Brandon Thomas
1742827ed9
ergonomics
2023-10-10 18:01:06 -04:00
Brandon Thomas
68bc9d0bb0
Merge pull request #89 from storytold/echelon-kubectl-cli
...
kubectl cli to cleanup dead pods
2023-10-10 17:51:12 -04:00
Brandon Thomas
ccc67d43cc
kubectl cli to cleanup dead pods
2023-10-10 17:50:05 -04:00
Michael Chung
3845c632b2
Turns out we don't support folder downloads only files.
2023-10-10 17:40:33 -04:00
Michael Chung
22518d9164
Fixed pathing typos
2023-10-10 16:24:16 -04:00
Michael Chung
5dbed7afbb
Fixed typo on downloading the vall-e-x model
2023-10-10 16:18:35 -04:00
Michael Chung
a485666b1c
Test pass!
...
Payload delivered and picked up.
Need to ensure the job now runs locally.
2023-10-10 16:03:27 -04:00
Michael Chung
54e9b8af70
Fixed routing issue with the job need to move tts text to maybe tts text out of the json.
2023-10-10 15:32:51 -04:00
kasisnu
5a7b0b1bdd
simple list dataset samples
2023-10-10 19:15:58 +05:30
kasisnu
ee0067161e
use usernames instead of user tokens to list voices/datasets
2023-10-10 18:03:22 +05:30
Brandon Thomas
a0f464e454
Merge pull request #87 from storytold/echelon-dataset-endpoints
...
Dataset endpoints, refactoring, cleanup, etc.
2023-10-10 03:22:21 -04:00
Brandon Thomas
332982faa5
Dataset endpoints, refactoring, cleanup, etc.
2023-10-10 03:16:11 -04:00
Brandon Thomas
c0e142d668
RMVPE support
2023-10-10 01:18:12 -04:00
Brandon Thomas
ca8dce4805
re-codegen db
2023-10-09 23:58:09 -04:00
Brandon Thomas
ed1eb9a540
stop dependabot from suggesting /old_code fixes (maybe delete all this?)
2023-10-09 23:30:16 -04:00
Brandon Thomas
0620fa6f98
extra tests for previously broken upgrade
2023-10-09 23:15:09 -04:00
Brandon Thomas
94adc01d62
Merge pull request #86 from storytold/echelon-cleanup-identifiers
...
Cleanup identifiers (tokens package)
2023-10-09 23:02:15 -04:00
Brandon Thomas
6e76cd3da6
Cleanup identifiers (tokens package)
2023-10-09 23:00:11 -04:00
Brandon Thomas
5a1fd2679c
fix for broken dependabot base64 upgrade (semvar violation)
2023-10-09 22:25:38 -04:00
dependabot[bot]
f5c3e12f90
Bump rust-s3 from 0.32.3 to 0.33.0
...
Bumps [rust-s3](https://github.com/durch/rust-s3 ) from 0.32.3 to 0.33.0.
- [Release notes](https://github.com/durch/rust-s3/releases )
- [Commits](https://github.com/durch/rust-s3/commits/v0.33.0 )
---
updated-dependencies:
- dependency-name: rust-s3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-10 02:02:36 +00:00
Brandon Thomas
0a141ea118
Merge pull request #84 from storytold/dependabot/cargo/cidr-utils-0.5.11
...
Bump cidr-utils from 0.5.10 to 0.5.11
2023-10-09 22:01:02 -04:00
Brandon Thomas
dd6c5d1975
Merge pull request #82 from storytold/dependabot/cargo/base64-0.21.0
...
Bump base64 from 0.13.0 to 0.21.0
2023-10-09 22:00:40 -04:00
Brandon Thomas
91dcd1f876
Merge pull request #83 from storytold/dependabot/cargo/unicode-segmentation-1.10.1
...
Bump unicode-segmentation from 1.7.1 to 1.10.1
2023-10-09 22:00:08 -04:00
Brandon Thomas
1869ead6ad
Merge pull request #85 from storytold/dependabot/cargo/futures-util-0.3.28
...
Bump futures-util from 0.3.26 to 0.3.28
2023-10-09 21:59:34 -04:00
Brandon Thomas
1c81874b28
fix tests and lints
2023-10-09 21:55:48 -04:00
Brandon Thomas
c8b79bfb40
cleanup logic
2023-10-09 21:44:14 -04:00
Brandon Thomas
767d76f831
comments about dev bucket
2023-10-09 21:04:36 -04:00
Brandon Thomas
b163791db2
Merge pull request #77 from storytold/feature/enqueue_tts_request
...
Feature/enqueue tts request
2023-10-09 21:02:26 -04:00
Brandon Thomas
d4e8bfb1f8
Merge pull request #79 from storytold/oct-06-mithoo
...
adds list dataset handler and update/delete voices handler
2023-10-09 20:58:25 -04:00
dependabot[bot]
fabc1583ca
Bump futures-util from 0.3.26 to 0.3.28
...
Bumps [futures-util](https://github.com/rust-lang/futures-rs ) from 0.3.26 to 0.3.28.
- [Release notes](https://github.com/rust-lang/futures-rs/releases )
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.26...0.3.28 )
---
updated-dependencies:
- dependency-name: futures-util
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:08:03 +00:00
dependabot[bot]
804ab3e4e8
Bump cidr-utils from 0.5.10 to 0.5.11
...
Bumps [cidr-utils](https://github.com/magiclen/cidr-utils ) from 0.5.10 to 0.5.11.
- [Commits](https://github.com/magiclen/cidr-utils/compare/v0.5.10...v0.5.11 )
---
updated-dependencies:
- dependency-name: cidr-utils
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:07:31 +00:00
dependabot[bot]
cd0e104808
Bump unicode-segmentation from 1.7.1 to 1.10.1
...
Bumps [unicode-segmentation](https://github.com/unicode-rs/unicode-segmentation ) from 1.7.1 to 1.10.1.
- [Commits](https://github.com/unicode-rs/unicode-segmentation/compare/1.7.1...v1.10.1 )
---
updated-dependencies:
- dependency-name: unicode-segmentation
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:07:00 +00:00
dependabot[bot]
a7d794e29b
Bump base64 from 0.13.0 to 0.21.0
...
Bumps [base64](https://github.com/marshallpierce/rust-base64 ) from 0.13.0 to 0.21.0.
- [Changelog](https://github.com/marshallpierce/rust-base64/blob/master/RELEASE-NOTES.md )
- [Commits](https://github.com/marshallpierce/rust-base64/compare/v0.13.0...v0.21.0 )
---
updated-dependencies:
- dependency-name: base64
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:05:57 +00:00
kasisnu
eed7dc28f8
adds simple voice list endpoint
2023-10-09 18:33:07 +05:30
kasisnu
d4c5710513
filter private/hidden datasets, make user token non-optional
2023-10-09 12:26:54 +05:30
Michael Chung
d8c4df4c02
Ok fixed the odd linting error.
2023-10-06 18:12:04 -04:00
Michael Chung
13809ad309
Fixed issue
2023-10-06 18:04:46 -04:00
Michael Chung
95888e683d
Formatter works now, braces can get properly placed
2023-10-06 18:01:25 -04:00
Michael Chung
3012dea984
process_single_tts_job augmented...
2023-10-06 17:58:07 -04:00
Michael Chung
ae899d8aca
Fixed most of the job and implemented it.
...
Need to run the container this might be fun haha ...
2023-10-06 15:21:38 -04:00
Michael Chung
dda05ba22c
Have to pull master for the lastest seed changes
2023-10-06 13:01:17 -04:00
Brandon Thomas
63795b2cb6
Merge pull request #81 from storytold/echelon-test-weights
...
Add zero shot weights and upload six test files; add to db seed tool
2023-10-06 12:51:20 -04:00
Brandon Thomas
8aa97a6a4f
Add zero shot weights and upload six test files; add to db seed tool
2023-10-06 12:50:02 -04:00
Michael Chung
e23369761b
Merge branch 'master' into feature/enqueue_tts_request
2023-10-06 11:35:11 -04:00
Brandon Thomas
2b27d6fe41
Merge pull request #80 from storytold/echelon-seed-tool-2
...
More seed tool things
2023-10-06 11:30:14 -04:00
Michael Chung
c6eefc41ec
Ok fixed the build now working on job running.
2023-10-06 10:55:51 -04:00
Michael Chung
9e3a3b79f9
job process wip
2023-10-06 09:49:09 -04:00
kasisnu
2aa063c354
some meat on the list datasets handler - filtering logic needs wdork
2023-10-06 18:04:44 +05:30
kasisnu
f77d4a636b
skip mod token when creating datasets
2023-10-06 16:07:29 +05:30
Brandon Thomas
018b05a3a2
Seed voice conversion models
2023-10-06 02:50:12 -04:00
kasisnu
fd3661e25d
list/delete voices simple handlers
2023-10-06 12:07:51 +05:30
Brandon Thomas
39de5aba13
More updates to seed tool
2023-10-06 01:30:43 -04:00
Brandon Thomas
6354e7c3b4
Merge pull request #78 from storytold/echelon-db-seeding
...
Database seed tool
2023-10-06 01:17:59 -04:00
Brandon Thomas
eaa9ddd62d
seed voice
2023-10-06 00:51:52 -04:00
Michael Chung
195a2eeb9c
Outlined the things needed to be done in process_job
2023-10-06 00:49:42 -04:00
Brandon Thomas
bef5dce947
seed dataset
2023-10-06 00:36:15 -04:00
Brandon Thomas
dd3f9c9d3e
move query modules
2023-10-06 00:19:41 -04:00
Brandon Thomas
aac31f77ad
Database seed tool
2023-10-06 00:09:42 -04:00
Brandon Thomas
d07a147db9
Merge pull request #62 from storytold/feat-create-dataset
...
create zs dataset endpoint - basic impl
2023-10-06 00:03:47 -04:00
Michael Chung
ba76acec35
some more fixes to model downloaders
2023-10-05 23:05:27 -04:00
Michael Chung
a2c196587f
Added Inference Command Stub
...
Added Create Embedding Command Stub
Need to implement job process:
Download Embedding File aka voice token.
model_downloaders is all good.
validate_job.
2023-10-05 22:29:25 -04:00
Brandon Thomas
8d36d6c709
Add some downloaders for vall-e-x
2023-10-05 21:43:36 -04:00
Michael Chung
4f5f6cfe51
Getting the pieces ready for inference_job
2023-10-05 13:29:51 -04:00
kasisnu
7c59f267fc
placeholder sql query to create a voice
2023-10-05 17:41:44 +05:30
kasisnu
23a6daa144
list handler questions
2023-10-05 16:34:36 +05:30
kasisnu
a22038ea31
delete datasets & allow mods to undelete
2023-10-05 15:59:56 +05:30
Michael Chung
5de40b2dab
Fix a build issues the payload sends exploring the job creation and inference side of it.
2023-10-04 16:30:46 -04:00
kasisnu
484e6788e3
enforce user token check
2023-10-04 19:02:16 +05:30
kasisnu
b67cfb5fbe
basic update dataset handler & synthetic id tracking
2023-10-04 18:03:13 +05:30
Brandon Thomas
d46075a2a3
codegen
2023-10-04 03:58:05 -04:00
Brandon Thomas
aa9b834f4b
Merge pull request #76 from storytold/echelon-add-media-file-extension
...
Add media prefix and file extension
2023-10-04 03:50:00 -04:00
Brandon Thomas
2abba4b639
populate prefix and extension
2023-10-04 03:34:43 -04:00
kasisnu
c42c091b2d
create zs dataset endpoint - basic impl
2023-10-04 12:32:58 +05:30
Brandon Thomas
cde8447a9c
add table for bucket prefix
2023-10-04 02:33:28 -04:00
Brandon Thomas
4306a4763d
Add extension
2023-10-04 02:24:28 -04:00
Brandon Thomas
9701e29b58
Migration to add file extension (eg. ".mp4")
2023-10-04 02:24:28 -04:00
Brandon Thomas
8512846efa
Merge pull request #75 from storytold/bt-revert-sqlx-upgrade
...
Revert "Bump sqlx-core from 0.6.2 to 0.7.2"
2023-10-04 02:23:09 -04:00
Brandon Thomas
c7b54e1548
Revert "Bump sqlx-core from 0.6.2 to 0.7.2"
...
This reverts commit 6b8c1a3106 .
2023-10-04 02:15:54 -04:00
Brandon Thomas
8343cf1b65
Merge pull request #70 from storytold/dependabot/cargo/sqlx-core-0.7.2
...
Bump sqlx-core from 0.6.2 to 0.7.2
2023-10-04 02:04:06 -04:00
Brandon Thomas
4d4b55d39d
Merge pull request #68 from storytold/dependabot/cargo/once_cell-1.18.0
...
Bump once_cell from 1.17.0 to 1.18.0
2023-10-04 02:03:54 -04:00
dependabot[bot]
6b8c1a3106
Bump sqlx-core from 0.6.2 to 0.7.2
...
Bumps [sqlx-core](https://github.com/launchbadge/sqlx ) from 0.6.2 to 0.7.2.
- [Changelog](https://github.com/launchbadge/sqlx/blob/main/CHANGELOG.md )
- [Commits](https://github.com/launchbadge/sqlx/commits )
---
updated-dependencies:
- dependency-name: sqlx-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 06:03:43 +00:00
Brandon Thomas
63b3cb8216
Merge pull request #67 from storytold/dependabot/cargo/url-2.4.1
...
Bump url from 2.3.1 to 2.4.1
2023-10-04 02:03:25 -04:00
Brandon Thomas
3d4522126e
Merge pull request #65 from storytold/dependabot/cargo/openssl-0.10.57
...
Bump openssl from 0.10.42 to 0.10.57
2023-10-04 02:02:33 -04:00
Brandon Thomas
8be1b5afa3
Merge pull request #69 from storytold/dependabot/cargo/actix-rt-2.9.0
...
Bump actix-rt from 2.7.0 to 2.9.0
2023-10-04 02:02:15 -04:00
dependabot[bot]
11f6995942
Bump actix-rt from 2.7.0 to 2.9.0
...
Bumps [actix-rt](https://github.com/actix/actix-net ) from 2.7.0 to 2.9.0.
- [Release notes](https://github.com/actix/actix-net/releases )
- [Commits](https://github.com/actix/actix-net/compare/rt-v2.7.0...rt-v2.9.0 )
---
updated-dependencies:
- dependency-name: actix-rt
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:56:36 +00:00
dependabot[bot]
589d13fdd1
Bump once_cell from 1.17.0 to 1.18.0
...
Bumps [once_cell](https://github.com/matklad/once_cell ) from 1.17.0 to 1.18.0.
- [Changelog](https://github.com/matklad/once_cell/blob/master/CHANGELOG.md )
- [Commits](https://github.com/matklad/once_cell/compare/v1.17.0...v1.18.0 )
---
updated-dependencies:
- dependency-name: once_cell
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:56:02 +00:00
dependabot[bot]
3f9160701f
Bump url from 2.3.1 to 2.4.1
...
Bumps [url](https://github.com/servo/rust-url ) from 2.3.1 to 2.4.1.
- [Release notes](https://github.com/servo/rust-url/releases )
- [Commits](https://github.com/servo/rust-url/compare/v2.3.1...v2.4.1 )
---
updated-dependencies:
- dependency-name: url
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:55:30 +00:00
Brandon Thomas
9e8c27edfd
Create dependabot.yml
2023-10-04 01:53:23 -04:00
dependabot[bot]
6540aed9dc
Bump openssl from 0.10.42 to 0.10.57
...
Bumps [openssl](https://github.com/sfackler/rust-openssl ) from 0.10.42 to 0.10.57.
- [Release notes](https://github.com/sfackler/rust-openssl/releases )
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.42...openssl-v0.10.57 )
---
updated-dependencies:
- dependency-name: openssl
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:53:08 +00:00
Brandon Thomas
7cd570083c
Merge pull request #64 from storytold/bt-misc-fix
...
fixing a few things
2023-10-04 01:10:15 -04:00
Brandon Thomas
8787e3ef1e
tests for lipsync payload
2023-10-04 01:09:40 -04:00
Brandon Thomas
49b25cc79d
fix query cache codegen
2023-10-04 01:09:40 -04:00
Brandon Thomas
eff73a9cff
actually check premium plan
2023-10-04 01:09:40 -04:00
Brandon Thomas
d0e3e0f6bb
Merge pull request #63 from storytold/bt-twitter-dimensions
...
SadTalker: Final API shape. Twitter dimensions, non-default options are opt-in, premium watermark
2023-10-04 00:31:00 -04:00
Brandon Thomas
e676df0bf4
premium plan features
2023-10-04 00:26:52 -04:00
Brandon Thomas
ebed726768
Resize SadTalker to "twitter" dimensions
2023-10-04 00:26:52 -04:00
Michael Chung
e0145f0e70
Test this endpoint ensure that the record is created and you can see it grabbed.
2023-10-03 19:09:09 -04:00
Brandon Thomas
2f3037514f
takedown requests
2023-10-03 13:38:13 -04:00
Michael Chung
f7c636cf58
Added TTS payloads should be able to enter a entry after a migration then follow the event
...
to the inference dispatch and fill out the code there.
2023-10-02 23:56:52 -04:00
Michael Chung
ec4a172929
Adding generic inference args and creating the job soon
2023-10-02 23:08:28 -04:00
Michael Chung
773b96fb35
Stubbing out work in the handler
...
Adding VallEX as a inference model type
Test pass
2023-10-02 21:45:40 -04:00
Michael Chung
40d0d0d844
Changing up enqueue_infer_tts_handler to allow embedding tokens.
2023-10-02 20:17:36 -04:00
Brandon Thomas
dbae9803e2
Merge pull request #61 from storytold/testing-and-images-libs
...
Libraries for testing and image processing
2023-10-02 16:21:28 -04:00
Brandon Thomas
87093bf291
Libraries for testing and image processing
...
Just getting started here.
2023-10-02 16:20:07 -04:00
Michael Chung
0b3ea3af2a
Working on enqueue_tts_request assuming the prompt is around.
2023-10-02 16:15:25 -04:00
ArEnSc
1a75d5b7b3
Merge pull request #60 from storytold/feature/postman-collections
...
Postman Collections
2023-10-02 14:58:16 -04:00
Michael Chung
fb5dbae029
Added the GPT4Prompt for generating the collections and posted some relevant end points.
2023-10-02 13:41:06 -04:00
Brandon Thomas
d2fba4349d
fix broken lint
2023-10-01 17:17:43 -04:00
Brandon Thomas
b76b4460e3
forgot to codegen after leaderboard query adjustment
2023-10-01 17:10:49 -04:00
Brandon Thomas
5fee53d7c7
Merge pull request #59 from storytold/echelon-sadtalker-options
...
More options for SadTalker
2023-10-01 17:07:33 -04:00
ArEnSc
4f589cd1b7
Merge pull request #58 from storytold/feature/Zeroshot-inference-job1
...
Feature/Stubs for Voice Designer?
2023-10-01 16:53:35 -04:00
Michael Chung
5b9f1551ee
Put stubs behind feature flag.
2023-10-01 16:51:14 -04:00
Michael Chung
e47125f12d
Nested the endpoints wrong because to many ))) and got confused.
2023-10-01 15:04:01 -04:00
Michael Chung
afa050b45e
Testing routes
2023-10-01 13:44:22 -04:00
Brandon Thomas
ab6986e4b4
Merge pull request #57 from storytold/echelon-hide-leaderboard
...
Hide Vegito's test account from TTS leaderboard
2023-10-01 05:45:20 -04:00
Brandon Thomas
53626cb312
More options for SadTalker
2023-10-01 05:07:56 -04:00
Brandon Thomas
a8810a2db8
Hide Vegito's account from TTS leaderboard
2023-09-30 11:07:08 -04:00
Michael Chung
cb8266d61e
Run then test end points for the responses
2023-09-30 01:43:56 -04:00
Michael Chung
056065458f
Early stubs
2023-09-30 01:43:25 -04:00
Michael Chung
7cb18d63f2
Initial stubs for the api
2023-09-30 01:27:36 -04:00
Michael Chung
12a119cc1b
Routing for the backend start
2023-09-29 20:30:09 -04:00
Brandon Thomas
c8d8546c57
Merge pull request #56 from storytold/echelon-zero-shot-tables
...
Zero shot tables
2023-09-29 00:10:16 -04:00
Brandon Thomas
3265e097c0
Zero shot tables
2023-09-28 23:45:31 -04:00
Brandon Thomas
695d3da34b
analytics query
2023-09-28 10:22:38 -04:00
Brandon Thomas
6733a19315
Merge pull request #55 from storytold/echelon-face-detection-early-failure
...
Do not respawn SadTalker jobs when face detection fails
2023-09-28 10:20:23 -04:00
Brandon Thomas
baefb9f7d6
Do not respawn SadTalker jobs when face detection fails
...
Currently SadTalker jobs will retry on failure, which is great for
worker nodes with transient issues. Unfortunately failure to detect a
face is a common user input error occuring in just around half of all
image uploads. This will permanently tombstone these jobs.
The new failure class can be reused for future animation systems that
rely on face detection.
There is still some minor work to do to surface this error to the
frontend / user in a friendly way.
2023-09-28 10:14:16 -04:00
Brandon Thomas
fc47232e6b
Update general_setup.md
2023-09-27 17:27:55 -04:00
Brandon Thomas
83dc262249
make lints and tests pass again
2023-09-26 02:13:16 -04:00
Brandon Thomas
1d3885c367
vendor in easyenv.rs (a crate I wrote)
2023-09-26 02:03:25 -04:00
Brandon Thomas
070433b416
Add watermarking capability
2023-09-22 11:49:55 -04:00
Brandon Thomas
f15b89cf3d
add face animation statistic to queue stats endpoint
2023-09-22 09:19:13 -04:00
Brandon Thomas
699bb6a6a7
Clion auto-optimize imports, remove dead imports, Clippy lint
2023-09-20 01:39:58 -04:00
Brandon Thomas
226f111a00
fix tests, lints
2023-09-20 01:07:26 -04:00
Brandon Thomas
b7794ab48f
ignore test data
2023-09-20 00:13:06 -04:00
Brandon Thomas
0bd5c9e93b
ignore c sources
2023-09-20 00:11:02 -04:00
ArEnSc
5a981f55aa
Merge pull request #54 from storytold/feature/General-Setup-Update
...
Feature/general setup update
2023-09-19 22:33:49 -04:00
michael chung
3e9581a29d
Minor update
2023-09-19 22:32:09 -04:00
michael chung
ab42870ff1
Updated General Setup!
2023-09-19 22:29:53 -04:00
michael chung
998c8ef49d
General Setup Guide Updates!
2023-09-19 22:09:29 -04:00
Brandon Thomas
aa8e7597ee
get rid of redundancy
2023-09-19 20:26:35 -04:00
Brandon Thomas
725d16bbd9
readme: hosts file, running application
2023-09-19 20:13:22 -04:00
Brandon Thomas
f6ee06a72f
updated setup README
2023-09-19 20:01:38 -04:00
Brandon Thomas
14d028ea8a
docs
2023-09-19 18:34:39 -04:00
Brandon Thomas
699c49c02f
cleanup docs
2023-09-19 18:31:00 -04:00
Brandon Thomas
b126998ee3
these are probably obsolete
2023-09-19 18:07:30 -04:00
Brandon Thomas
1b43433b72
Documentation updates
2023-09-19 18:06:37 -04:00
Brandon Thomas
1f7dc268a8
SadTalker arguments (wip)
2023-09-19 17:27:34 -04:00
Brandon Thomas
dda67adc52
optional alternate checkpoint path arg
2023-09-15 10:07:33 -04:00
Brandon Thomas
fa74b9715f
logging for job
2023-09-15 09:28:41 -04:00
Brandon Thomas
653a0b26ce
sleep(50) - ugh
2023-09-15 08:51:44 -04:00
Brandon Thomas
ab8e9b9134
sqlite was failing, emit which is being prepared
2023-09-15 06:36:11 -04:00
Brandon Thomas
dac67ada23
codegen db
2023-09-15 06:35:04 -04:00
Brandon Thomas
f56530e36b
Merge pull request #53 from storytold/bt-sadtalker-backup-2.2
...
Sad Talker worker, file uploads, etc.
2023-09-15 06:32:45 -04:00
Brandon Thomas
3077359165
logs
2023-09-15 06:29:22 -04:00
Brandon Thomas
efdb0377f4
serve bucket paths
2023-09-15 06:15:11 -04:00
Brandon Thomas
4e935a1c2b
worker details
2023-09-15 04:43:23 -04:00
Brandon Thomas
063760663f
get job working again
2023-09-15 04:14:38 -04:00
Brandon Thomas
176cbcc4be
remove directory full path, work on query
2023-09-15 03:33:55 -04:00
Brandon Thomas
359b7a5bd0
migrations, about to insert media file result
2023-09-15 02:19:41 -04:00
Brandon Thomas
9f67a3b82d
SadTalker inference works !
2023-09-14 05:33:08 -04:00
Brandon Thomas
eb0e05f61e
download image and audio
2023-09-14 04:58:28 -04:00
Brandon Thomas
24f6b3c2f6
upload image route
2023-09-12 20:04:58 -04:00
Brandon Thomas
c47bae40d4
download voice conversion result
2023-09-12 20:04:58 -04:00
Brandon Thomas
cf2c246bc2
voice_conversion_for_inference
2023-09-12 20:04:58 -04:00
Brandon Thomas
9b89402549
get_voice_conversion_result query
2023-09-12 20:04:58 -04:00
Brandon Thomas
f2f2bd465c
wip
2023-09-12 20:04:58 -04:00
Brandon Thomas
7e9acc6476
unpack args
2023-09-12 20:04:58 -04:00
Brandon Thomas
7d68347f4f
fixed enqueue, fixed downloaders
2023-09-12 20:04:58 -04:00
Brandon Thomas
655f9fad7d
downloaders
2023-09-12 20:04:58 -04:00
Brandon Thomas
754581ec70
impl_model_downloader appears to work
2023-09-12 20:04:58 -04:00
Brandon Thomas
80b7352581
async trait/macro starting to work
2023-09-12 20:04:58 -04:00
Brandon Thomas
dd7bd71587
model downloader trait wip
2023-09-12 20:04:58 -04:00
Brandon Thomas
e41f72305b
(from other laptop) - inference args work, inference-job boilerplate
2023-09-12 20:04:58 -04:00
Brandon Thomas
fa2a15a4f2
install route
2023-09-12 20:04:58 -04:00
Brandon Thomas
eddb71d712
enqueue animation endpoint + more plumbing
2023-09-12 20:04:58 -04:00
Brandon Thomas
71758e6616
upload images (untested)
2023-09-12 20:04:58 -04:00
Brandon Thomas
7afa50ce29
another 101soundboards account
2023-09-12 18:42:38 -04:00
Brandon Thomas
14480e50b4
analytics queries
2023-08-31 22:45:43 -04:00
Brandon Thomas
b99e4c5edb
more 101soundboards accounts and notes
2023-08-31 22:31:38 -04:00
Brandon Thomas
f5b7ad0428
analytics queries
2023-08-30 22:49:55 -04:00
Brandon Thomas
ff2713358d
imyfone notes
2023-08-28 21:37:28 -04:00
Brandon Thomas
60ab3565bd
101soundboards notes
2023-08-28 21:34:53 -04:00
Brandon Thomas
d4ee7a8673
ban some abusers
2023-08-28 21:31:49 -04:00
Brandon Thomas
8e15e1e14c
media_files enums
2023-08-23 21:33:06 -04:00
Brandon Thomas
a8f0947352
media file token
2023-08-23 21:14:45 -04:00
Brandon Thomas
2600762df2
mysql table: media_files
2023-08-23 21:01:49 -04:00
Brandon Thomas
1100fc1a91
clion/intellij formatting rules
2023-08-23 18:03:56 -04:00
Brandon Thomas
a538989c57
UserInfoLite shared response type
2023-08-23 18:03:36 -04:00
Brandon Thomas
a4524ee679
execute all lints and tests
2023-08-23 17:13:11 -04:00
Brandon Thomas
1551a014a4
revisit rustfmt with minimal changes to formatting
2023-08-21 00:59:52 -04:00
Brandon Thomas
e5afff51a6
Change rustfmt rules
2023-08-21 00:32:17 -04:00
Brandon Thomas
9a7b746460
return statement lint
2023-08-21 00:23:09 -04:00
Brandon Thomas
a63b085086
Clippy: fix for newrelic, lint duplicate field name
2023-08-20 21:56:20 -04:00
Brandon Thomas
3b40f005d0
add storyteller.ai hostname
2023-08-20 21:01:57 -04:00
Brandon Thomas
afc4fbdcb5
lints
2023-08-20 20:59:22 -04:00
Brandon Thomas
63008a7fe8
analytics query
2023-08-18 09:01:57 -04:00
Brandon Thomas
902c840833
takedown request
2023-08-18 08:49:05 -04:00
Brandon Thomas
e8a8c6349f
clippy
2023-08-16 16:00:37 -04:00
Brandon Thomas
76a62eaece
more lints (add gradually)
2023-08-16 02:57:06 -04:00
Brandon Thomas
226fb93a36
lint progress
2023-08-16 02:28:48 -04:00
Brandon Thomas
1868170c31
more progress on lints
2023-08-16 01:51:30 -04:00
Brandon Thomas
7ecdac5151
Lint script
2023-08-16 01:34:24 -04:00
Brandon Thomas
f41833e4f4
cargo cranky: &'static
2023-08-15 23:56:03 -04:00
Brandon Thomas
bd9c4d752f
move includes to single root dir
2023-08-15 23:42:01 -04:00
Brandon Thomas
7dab1b9ea1
username reservations
2023-08-14 14:33:32 -04:00
Brandon Thomas
512b214fb8
cargo 'cranky' (clippy helper)
2023-08-10 16:50:25 -04:00
Brandon Thomas
21e2eeac68
remove more duplicates
2023-08-10 15:28:43 -04:00
Brandon Thomas
ec7a61a08e
remove duplicates
2023-08-10 15:00:05 -04:00
Brandon Thomas
c195a23425
inventory duplicates
2023-08-10 14:49:03 -04:00
Brandon Thomas
2c61db12d6
takedown requests
2023-08-10 14:36:24 -04:00
Brandon Thomas
8bac7ca332
analytics queries
2023-08-10 14:22:32 -04:00
Brandon Thomas
56fb99aa81
takedown request
2023-08-07 16:28:58 -04:00
Brandon Thomas
e87091c5cb
re-codegen
2023-07-30 18:13:30 -04:00
Brandon Thomas
ffb081777d
Enrich stats query with per-queue info
2023-07-30 18:12:45 -04:00
Brandon Thomas
e8be6f9775
improved queue length query
2023-07-30 17:26:07 -04:00
Brandon Thomas
2094ab2fe8
query
2023-07-30 16:21:23 -04:00
Brandon Thomas
596434868c
takedown requests, duplicates
2023-07-30 00:15:40 -04:00
Brandon Thomas
14c5f02127
takedown requests
2023-07-30 00:04:07 -04:00
Brandon Thomas
ffc018ee18
broken clients
2023-07-27 23:54:57 -04:00
Brandon Thomas
0b7f08e838
cache queue stats in Redis
2023-07-27 04:03:07 -04:00
Brandon Thomas
3a8398a94e
much better logging for download jobs
2023-07-27 03:10:55 -04:00
Brandon Thomas
35e26e7f72
more queries
2023-07-27 02:48:00 -04:00
Brandon Thomas
3e6b4c43af
scope download job
2023-07-27 01:30:33 -04:00
Brandon Thomas
e5289809fd
more analytics queries
2023-07-26 01:13:38 -04:00
Brandon Thomas
b335e1839c
analytics queries
2023-07-25 16:59:08 -04:00
Brandon Thomas
ce3f83e9af
subscriber analytics
2023-07-24 23:46:36 -04:00
Brandon Thomas
e324c6ce44
query to restart failed downloads
2023-07-24 20:43:38 -04:00
Brandon Thomas
062a80fafa
more analytics, etc. queries
2023-07-24 19:22:47 -04:00
Brandon Thomas
986e8b104a
most popular VC models analytics query
2023-07-24 17:15:06 -04:00
Brandon Thomas
1e948a51e9
logging, common media upload query
2023-07-24 02:06:16 -04:00
Brandon Thomas
f9b7a0e774
fix bug
2023-07-23 23:41:21 -04:00
Brandon Thomas
4db56881c0
debugging type error
2023-07-23 23:36:57 -04:00
Brandon Thomas
c11b2f0a94
better logging
2023-07-23 21:46:26 -04:00
Brandon Thomas
3d9a0cfcc1
scoped job execution
2023-07-23 21:32:39 -04:00
Brandon Thomas
b019968ce1
re codegen db
2023-07-23 19:12:59 -04:00
Brandon Thomas
31c88d6d64
Poll voice conversion model info; pull from cache
2023-07-23 19:12:16 -04:00
Brandon Thomas
a601998fa5
query for voice conversion model info
2023-07-23 18:08:45 -04:00
Brandon Thomas
c1ccfb419a
in-memory token info cache
2023-07-23 17:54:41 -04:00
Brandon Thomas
d9a1fcf989
types on inference jobs are wrong (gradually fixing)
2023-07-23 17:33:57 -04:00
Brandon Thomas
839b33425a
keep alive elapses shouldn't be system failures
2023-07-20 23:58:29 -04:00
Brandon Thomas
8017fef05a
rename files across devices
2023-07-20 23:50:19 -04:00
Brandon Thomas
0534db0033
inference-job: more logging, default location for rvc hubert
2023-07-20 23:30:53 -04:00
Brandon Thomas
ef53568dcf
correct comment
2023-07-20 20:16:58 -04:00
Brandon Thomas
72c5c99a1c
no longer log nvidia-smi spam
2023-07-20 20:16:32 -04:00
Brandon Thomas
0b0a9c428c
fix python logger issue with rvc-v2
2023-07-20 19:58:46 -04:00
Brandon Thomas
a9f0b1d485
fix deletion of directory bug
2023-07-20 18:07:52 -04:00
Brandon Thomas
76dc39df16
Fix list jobs query (now that it isn't statically typed)
2023-07-20 18:04:53 -04:00
Brandon Thomas
79d8af8bf4
re-codegen db
2023-07-20 17:44:03 -04:00
Brandon Thomas
b1d69ba9ac
no-op comment to trigger build
2023-07-20 15:06:17 -04:00
Brandon Thomas
ffcf460291
scope download job type
2023-07-20 14:40:28 -04:00
Brandon Thomas
f0a8b6d175
additional logging for download-job
2023-07-20 01:41:59 -04:00
Brandon Thomas
e3a5d68fcc
download hubert for inference-job
2023-07-20 00:02:41 -04:00
Brandon Thomas
877b95a00c
Download pretrained hubert for download-job
2023-07-19 23:36:38 -04:00
Brandon Thomas
20e32ff3e3
begin handling hubert
2023-07-19 22:35:42 -04:00
Brandon Thomas
97a6f6e4ff
add health checker to download-job
2023-07-19 19:52:24 -04:00
Brandon Thomas
cf27fca799
Merge pull request #52 from storytold/bt-upgrade-actix-4
...
upgrade to actix 4
2023-07-19 02:53:40 -04:00
Brandon Thomas
5eab05753f
fix broken tests
2023-07-19 02:52:11 -04:00
Brandon Thomas
385e1e53c1
update middleware
2023-07-19 02:41:40 -04:00
Brandon Thomas
039e61499f
fix routes generics / upgrade generics on routing pieces
2023-07-19 01:57:51 -04:00
Brandon Thomas
9dd91ce7cc
only a few compile errors left with storyteller-web
2023-07-19 01:09:10 -04:00
Brandon Thomas
a75c1f391a
Upgrade actix partially (was on beta version)
...
Old version was causing conflicts with zip and transitive bzip
dependency, so it's time to upgrade. We need to get to the next version
number soon anyway.
2023-07-19 00:20:49 -04:00
Brandon Thomas
d833b3babd
Merge pull request #51 from storytold/bt-rvc-v2-support
...
RVC v2 support
2023-07-18 23:06:49 -04:00
Brandon Thomas
1427e3eecd
Handle zip files with .index files
2023-07-18 23:05:46 -04:00
Brandon Thomas
45990f5631
research
2023-07-18 17:57:37 -04:00
Brandon Thomas
5653a918c0
codegen db (was there an sqlite issue?)
2023-07-18 16:53:08 -04:00
Brandon Thomas
8172774a98
Handle RVC models without an index file
2023-07-18 16:50:44 -04:00
Brandon Thomas
6189d6fe9d
working rvc(v2), it needs cleanup; also fixed race condition
2023-07-18 02:13:46 -04:00
Brandon Thomas
395940ef34
Progress on rvc inference job (not working yet)
2023-07-18 01:55:39 -04:00
Brandon Thomas
85cfc0cf2e
env files
2023-07-18 00:10:57 -04:00
Brandon Thomas
93e066e70b
fixing rvc uploads
2023-07-17 17:10:14 -04:00
Brandon Thomas
5cb79a5a33
Begin work on download-job rvc-v2 support
2023-07-17 16:24:35 -04:00
Brandon Thomas
6b06a825f3
Merge pull request #50 from storytold/bt-saj-rvc-integration
...
Bt saj rvc integration
2023-07-16 19:26:23 -04:00
Brandon Thomas
d653260ee5
Change enum variant name
2023-07-16 19:22:00 -04:00
Paul Sajna
c8530e186e
rvc stubs
2023-07-15 21:56:46 -04:00
Brandon Thomas
aee52c04ff
Fix failing builds (everything was working before)
...
Something mysteriously made my machine think we needed nightly.
Begone, nightly.
2023-07-15 21:55:59 -04:00
Brandon Thomas
cd91acb4a8
fix compile error
2023-07-15 21:13:37 -04:00
Brandon Thomas
d591472478
Merge pull request #49 from storytold/new-queries
...
new queries
2023-07-14 10:59:11 -04:00
Brandon Thomas
c14073f06d
new queries
2023-07-14 10:58:34 -04:00
Brandon Thomas
edde256ff6
delete more duplicates
2023-06-27 15:33:50 -07:00
Brandon Thomas
c6bcd25b19
get rid of takedown request models, duplicate models
2023-06-27 15:20:37 -07:00
Brandon Thomas
82c1563459
comments about users
2023-06-25 21:51:18 -07:00
Brandon Thomas
866ed89d9c
refactor disabled endpoint filter
2023-06-25 21:21:53 -07:00
Brandon Thomas
ac4ffb4f34
refactor
2023-06-25 20:57:36 -07:00
Brandon Thomas
41fe0866d4
refactor ip filter
2023-06-25 20:42:06 -07:00
Brandon Thomas
de3e2e8924
cidr refactor
2023-06-25 20:28:31 -07:00
Brandon Thomas
800c9bd9d5
Add cidr filter
2023-06-25 20:11:59 -07:00
Brandon Thomas
1fe62a2570
Actix CIDR filter
2023-06-25 19:59:01 -07:00
Brandon Thomas
f293b56089
Merge pull request #47 from storytold/bt-block-alibaba
...
block a few Alibaba IPs
2023-06-23 21:23:43 -04:00
Brandon Thomas
a0a2d1434f
block a few Alibaba IPs
2023-06-23 18:23:03 -07:00
Brandon Thomas
8ba1d9f303
Merge pull request #45 from storytold/bevy-experiments
...
roko bevy testing
2023-06-20 10:17:23 -04:00
Paul Sajna
a11779e3aa
roko bevy testing
2023-06-19 11:31:32 -07:00
Brandon Thomas
5c46fd7c60
easier to see logs in k8s
2023-06-17 19:02:28 -07:00
Brandon Thomas
09e26164b8
even beefier build machines
2023-06-17 18:32:58 -07:00
Brandon Thomas
8c24b0c755
log job successes
2023-06-17 18:18:15 -07:00
Brandon Thomas
83ae73d8d0
improperly counting successes
2023-06-17 18:05:34 -07:00
Brandon Thomas
1d0db0eeb9
install nvidia-container packages
2023-06-17 16:12:19 -07:00
Brandon Thomas
04581d06ee
better exit status
2023-06-17 14:14:29 -07:00
Brandon Thomas
a31ecc01ab
configurable health threshold
2023-06-17 11:43:25 -07:00
Brandon Thomas
be20e105ea
Health check HTTP server runs and shuts down
2023-06-17 11:39:34 -07:00
Brandon Thomas
67864f3db2
Both job and HTTP server (doesn't respond to ctrl-c)
2023-06-17 11:05:27 -07:00
Brandon Thomas
10c277d9cf
health check endpoint (not installed)
2023-06-17 07:49:27 -07:00
Brandon Thomas
c6e4c2e274
job stats (consecutive success, failure) for inference-job
2023-06-16 21:42:00 -07:00
Brandon Thomas
a3815ad64d
Merge pull request #43 from storytold/saj-audiowmark
...
audiowmark wrapper
2023-05-29 23:23:37 -04:00
Paul Sajna
8cd48fcf58
audiowmark wrapper
2023-05-29 20:15:45 -07:00
Brandon Thomas
523c02326b
more logging
2023-05-28 22:34:48 -07:00
Brandon Thomas
37eef276a0
more logger methods
2023-05-28 21:20:30 -07:00
Brandon Thomas
f5cbedb230
fix logger
2023-05-28 21:01:14 -07:00
Brandon Thomas
6994a9c2ce
documentation
2023-05-28 19:07:45 -07:00
Brandon Thomas
213742ff29
override python logger in dockerfile
2023-05-28 19:05:51 -07:00
Brandon Thomas
df4f1e6a6c
fix log levels
2023-05-28 19:04:09 -07:00
Brandon Thomas
64fa281bc1
parameter for flushing logs
2023-05-28 18:52:01 -07:00
Brandon Thomas
bd386aa70b
don't need the logger.py in isolation
2023-05-28 18:16:35 -07:00
Brandon Thomas
28875c9272
Add patches to upstream logger
2023-05-28 18:16:11 -07:00
Brandon Thomas
a79bfc7a24
add version of logger we're using in production - we'll patch instead
2023-05-28 17:42:32 -07:00
Brandon Thomas
ecca8ff17c
we'll need to replace python logging in our container for performance
2023-05-28 17:33:04 -07:00
Brandon Thomas
a3cabf6779
fix import
2023-05-28 00:53:59 -07:00
Brandon Thomas
dd35a7cca9
ignore sensitive env vars
2023-05-28 00:52:05 -07:00
Brandon Thomas
f876cac4cf
job pause file
2023-05-27 23:23:42 -07:00
Brandon Thomas
d2b840cb13
analytics queries
2023-05-27 00:32:09 -07:00
Brandon Thomas
85bac00194
password_reset table
2023-05-23 02:12:58 -07:00
Brandon Thomas
367a516f89
fix option typo
2023-05-23 01:41:01 -07:00
Brandon Thomas
5fe85072a2
pack more in docker container, "hacky fix" flag for so-vits-svc
2023-05-23 00:16:11 -07:00
Brandon Thomas
5867d2356c
install vim
2023-05-22 22:21:53 -07:00
Brandon Thomas
275333c1ed
netstat in docker image
2023-05-22 17:44:41 -07:00
Brandon Thomas
5ec2cde68f
report errors better
2023-05-22 11:15:19 -07:00
Brandon Thomas
daf5a63f86
cleanup temp dir
2023-05-22 02:44:34 -07:00
Brandon Thomas
2fe3d5dc99
add less to container
2023-05-22 02:38:20 -07:00
Brandon Thomas
44df952bd1
fix inference job path for VC uploaded audio
2023-05-22 01:51:12 -07:00
Brandon Thomas
5bf98f70d9
rework where temp storage lives: download vs workspace
2023-05-22 00:52:49 -07:00
Brandon Thomas
af685b37cf
fix keepalive redis in job
2023-05-21 22:11:19 -07:00
Brandon Thomas
0f7ff50cf6
better error logging
2023-05-21 20:01:08 -07:00
Brandon Thomas
1ae8d8d615
Fail jobs with elapsed keepalive
2023-05-21 18:16:44 -07:00
Brandon Thomas
63c0124267
test execution safety
2023-05-21 17:52:53 -07:00
Brandon Thomas
17e8c1942e
codegen db
2023-05-21 17:49:58 -07:00
Brandon Thomas
cf24a07bba
Set keepalive key
2023-05-21 17:48:29 -07:00
Brandon Thomas
9ece30722f
Enqueue inferene with keepalive flag
2023-05-21 17:21:17 -07:00
Brandon Thomas
9ab977d016
Add job table keepalive column
2023-05-21 17:04:02 -07:00
Brandon Thomas
ebd3f52717
tmux to gpu container
2023-05-19 04:22:53 -07:00
Brandon Thomas
35a75e144a
unban IP
2023-05-19 04:08:29 -07:00
Brandon Thomas
4b145a7419
Patch for firefox opus audio uploads failing
2023-05-19 04:06:36 -07:00
Brandon Thomas
eb539e9142
query was wrong
2023-05-19 02:08:51 -07:00
Brandon Thomas
37604cdd7b
config
2023-05-19 02:48:22 -04:00
Brandon Thomas
f724031aa3
config
2023-05-19 02:44:14 -04:00
Brandon Thomas
b8b10f6fc1
f0-method and frequency transpose for job
2023-05-18 12:17:08 -07:00
Brandon Thomas
bd4bcab2c2
args for pitch/f0 method in http handler
2023-05-18 00:14:42 -07:00
Brandon Thomas
caa3e3ae53
clear filesystem when full
2023-05-16 01:13:54 -07:00
Brandon Thomas
7cd8099ab5
variable length tts inference text
2023-05-15 00:47:57 -07:00
Brandon Thomas
6ec39b9c68
loyalty for VC contributors
2023-05-14 21:00:27 -07:00
Brandon Thomas
c8b4b7daa0
analytics queries
2023-05-13 09:27:57 -07:00
Brandon Thomas
a294549d02
queries
2023-05-09 12:55:07 -04:00
Brandon Thomas
33ff75274f
add ripgrep
2023-05-04 06:17:12 -07:00
Brandon Thomas
945e5226c5
add a few tools to the container
2023-05-04 03:47:54 -07:00
Brandon Thomas
85a52cd26e
config comments
2023-05-04 03:09:23 -04:00
Brandon Thomas
32ee4209da
this configuration works
2023-05-04 03:07:38 -04:00
Brandon Thomas
f94cdac47d
local dev confi
2023-05-03 23:18:53 -04:00
Brandon Thomas
a2ea870ac7
update nvidia driver ???
2023-05-02 23:01:29 -07:00
Brandon Thomas
a2c48d7469
kill subprocess if timeout elapses
2023-05-02 22:19:03 -07:00
Brandon Thomas
fe3dd7d66b
add routing tags to inference jobs
2023-05-02 21:31:39 -07:00
Brandon Thomas
88fae4ba89
timeout argument
2023-05-02 06:12:49 -07:00
Brandon Thomas
6505e67bf2
analytics
2023-05-02 04:37:21 -07:00
Brandon Thomas
3453fe0e3b
add minor logging
2023-05-02 01:18:25 -07:00
Brandon Thomas
8b36d870d1
fix inference job, add env perameter for threshold
2023-05-01 06:52:34 -07:00
Brandon Thomas
9555ac51fe
Skip jobs that aren't on filesystem
2023-05-01 06:42:41 -07:00
Brandon Thomas
f00b4011b5
record inferecne duration stats to db
2023-05-01 04:17:36 -07:00
Brandon Thomas
d1d208d714
add more timing stats to the jobs tables
2023-05-01 03:59:05 -07:00
Brandon Thomas
a5ce9a3cc4
analytics
2023-04-30 08:16:27 -07:00
Brandon Thomas
6ad2468e59
analytics queries
2023-04-30 08:09:07 -07:00
Brandon Thomas
c59695343f
extend media/symphonia to work with webm+opus
2023-04-30 05:03:40 -07:00
Brandon Thomas
52a83609b6
test case for failing web browser uploads
2023-04-30 00:31:03 -07:00
Brandon Thomas
f710b68a3e
Fix broken tests, add testing script
2023-04-29 23:56:48 -07:00
Brandon Thomas
3d63e34ca1
analytics queries
2023-04-29 23:36:02 -07:00
Brandon Thomas
4a1f1441bf
split analytics and operational queries
2023-04-29 06:08:34 -07:00
Brandon Thomas
ee90f03436
add extra inference job stats
2023-04-29 05:11:57 -07:00
Brandon Thomas
1858aea619
new job queue stats endpoint
2023-04-29 04:58:51 -07:00
Brandon Thomas
592ba627be
documentation
2023-04-29 03:53:31 -07:00
Brandon Thomas
f754c6e41f
add execution time to job queries
2023-04-29 03:10:31 -07:00
Brandon Thomas
54af3d301c
Add execution millis columns to jobs tables
2023-04-29 02:41:49 -07:00
Brandon Thomas
22eeacf355
stricter compiler flags
2023-04-29 02:30:41 -07:00
Brandon Thomas
630aa497f3
note
2023-04-29 02:28:32 -07:00
Brandon Thomas
6e9c05c596
bootstrap / env config improved, on-prem, etc.
2023-04-29 02:26:13 -07:00
Brandon Thomas
3f781ad98f
clean up worker hostname / cluster name in jobs
2023-04-29 02:16:17 -07:00
Brandon Thomas
5d038fdf8f
codegen db
2023-04-29 01:50:14 -07:00
Brandon Thomas
a09acf7c53
add extra metadata to inference and download jobs
2023-04-29 01:49:25 -07:00
Brandon Thomas
3ba64618c3
add tracking columns to generic_inference_job too
2023-04-29 00:17:44 -07:00
Brandon Thomas
73e583c7ed
Add extra metadata tracking to generic download jobs table
2023-04-29 00:08:54 -07:00
Brandon Thomas
1d7a54f640
python for docker image
2023-04-28 16:09:38 -07:00
Brandon Thomas
552fae54a7
fix
2023-04-28 16:02:04 -07:00
Brandon Thomas
4d2ae85fd9
send hubert path for docker
2023-04-28 16:01:18 -07:00
Brandon Thomas
76775dec60
hubert path config
2023-04-28 15:54:53 -07:00
Brandon Thomas
22bc8d54a0
organize settings
2023-04-28 18:46:18 -04:00
Brandon Thomas
878bff867a
fix dev env vars
2023-04-28 02:01:11 -04:00
Brandon Thomas
05d5bfc1a7
rename
2023-04-27 23:00:16 -07:00
Brandon Thomas
3acdd0b5e2
rebase fix
2023-04-28 01:47:40 -04:00
Brandon Thomas
1a7a74ee8a
so-vits-svc auto_predict_f0 default to false, add option
2023-04-27 22:45:28 -07:00
Brandon Thomas
820f4ebc32
fix firefox/opus again
2023-04-27 15:54:13 -07:00
Brandon Thomas
423fb369db
add audio/opus
2023-04-27 08:15:46 -07:00
Brandon Thomas
2a58079289
copy all env vars to child process
2023-04-27 07:19:46 -07:00
Brandon Thomas
b2df674178
report mimetype errors
2023-04-27 02:00:31 -07:00
Brandon Thomas
1fd33e76b4
update base image
2023-04-27 01:02:23 -07:00
Brandon Thomas
824683b974
fixup dockerfile
2023-04-27 00:50:45 -07:00
Brandon Thomas
4bed11d21d
change name again
2023-04-27 00:12:48 -07:00
Brandon Thomas
13bdcbdda6
fix names of actions
2023-04-27 00:11:40 -07:00
Brandon Thomas
f49c724303
GPU + CPU dockerfiles
2023-04-27 00:09:31 -07:00
Brandon Thomas
a9502c183b
flexible config path for inference job
2023-04-26 10:17:49 -07:00
Brandon Thomas
b469a237ce
temporarily add nvidia/sound packages to rust monorepo images
2023-04-26 09:14:17 -07:00
Brandon Thomas
0df93c48c3
configs for download job
2023-04-26 07:48:31 -07:00
Brandon Thomas
070c192633
set config and test wav upfront and at runtime
2023-04-26 07:43:59 -07:00
Brandon Thomas
75a68c7e0f
install python
2023-04-26 05:45:28 -07:00
Brandon Thomas
b2db079cf5
env vars for docker
2023-04-26 04:46:40 -07:00
Brandon Thomas
6658281a1c
try more env vars for caching
2023-04-26 04:38:27 -07:00
Brandon Thomas
8cb04f1dcb
huggingface+nltk caches
2023-04-26 04:25:43 -07:00
Brandon Thomas
58f6ee68df
more flexible command specification
2023-04-26 04:11:06 -07:00
Brandon Thomas
d0cef7bec9
hack
2023-04-26 03:30:38 -07:00
Brandon Thomas
8eed406fbd
inference-job hack (see if we can run without 'svc' command)
2023-04-26 01:31:02 -07:00
Brandon Thomas
44586c4cee
copy the correct env var files
2023-04-25 20:56:18 -07:00
Brandon Thomas
02f5aacb8e
more robust configuration of download-job
2023-04-25 20:55:18 -07:00
Brandon Thomas
001ff86ed3
robust configuration for download-job
2023-04-25 20:51:51 -07:00
Brandon Thomas
94b406eca2
much more robust app initialization
2023-04-25 20:44:59 -07:00
Brandon Thomas
f8bdea1b3b
build error fix
2023-04-25 17:20:21 -07:00
Brandon Thomas
8a37a7240c
more DDoS IPs
2023-04-25 17:16:29 -07:00
Brandon Thomas
a4c1abfe9c
codegen
2023-04-25 06:07:01 -07:00
Brandon Thomas
6bb7a18676
report model title
2023-04-25 04:13:28 -07:00
Brandon Thomas
a8173226ea
report bucket hash in results
2023-04-25 03:00:31 -07:00
Brandon Thomas
692c3f64b6
two different firehose notifications
2023-04-25 01:33:47 -07:00
Brandon Thomas
4842b9bbc1
local dev config changes
2023-04-25 04:28:00 -04:00
Brandon Thomas
a507f8bc38
nope, didn't work
2023-04-25 01:27:28 -07:00
Brandon Thomas
24f2c07199
try to fix duration bug
2023-04-25 01:25:13 -07:00
Brandon Thomas
e871dde078
add upload source
2023-04-25 01:09:24 -07:00
Brandon Thomas
47ff379018
timeout
2023-04-24 02:53:59 -07:00
Brandon Thomas
cdb0f37889
downgrode symphonia off-master branch to support opus for browsers
2023-04-24 02:32:13 -07:00
Brandon Thomas
6d7c3c6e5f
maybe build with correct codecs?
2023-04-24 01:46:52 -07:00
Brandon Thomas
7b72d51bd3
debug logging
2023-04-24 01:11:37 -07:00
Brandon Thomas
11a9e1249c
remove inference args (for now)
2023-04-23 23:29:09 -07:00
Brandon Thomas
f3a6ddb70a
premium priority levels
2023-04-23 23:05:24 -07:00
Brandon Thomas
d2aa07228b
simplify upload endpoint
2023-04-23 22:30:13 -07:00
Brandon Thomas
a2c3668beb
upload audio endpoint
2023-04-23 22:25:46 -07:00
Brandon Thomas
15d66a4530
propagate media input token to inference result
2023-04-23 20:48:09 -07:00
Brandon Thomas
75523811e4
ops query
2023-04-23 13:59:01 -07:00
Brandon Thomas
4672102da4
code changes stemming from schema changes
2023-04-23 05:03:37 -07:00
Brandon Thomas
ca59189dd9
simplify media_uploads schema
2023-04-23 04:31:00 -07:00
Brandon Thomas
3564c1b459
more schema mods
2023-04-23 04:13:50 -07:00
Brandon Thomas
78263e3c49
media token type
2023-04-23 03:58:16 -07:00
Brandon Thomas
e36fb66e05
migrate voice_conversion_results
2023-04-23 03:24:05 -07:00
Brandon Thomas
1540d87018
cleanup
2023-04-23 02:12:46 -07:00
Brandon Thomas
61f0869359
calculate result metadata
2023-04-23 02:02:49 -07:00
Brandon Thomas
d23c7abfeb
remove deprecated crate -> move hashing + mimetype functions out
2023-04-23 01:31:58 -07:00
Brandon Thomas
2d59891dee
organize "file"-related/adjacent crates together
2023-04-23 00:27:09 -07:00
Brandon Thomas
2f86bc75ac
crate to handle just mimetype ops
2023-04-23 00:08:59 -07:00
Brandon Thomas
8c5fb0bee2
badge granter for voice conversion models
2023-04-22 06:22:06 -07:00
Brandon Thomas
b9f0d7749d
fix transaction
2023-04-22 05:36:22 -07:00
Brandon Thomas
b2caa3758a
fix synthetic id
2023-04-22 05:22:06 -07:00
Brandon Thomas
de656d4d74
fix
2023-04-22 04:47:09 -07:00
Brandon Thomas
c803232a52
creator synthetic id
2023-04-22 04:44:40 -07:00
Brandon Thomas
cd9b0080dd
fix result upload directory
2023-04-22 04:04:15 -07:00
Brandon Thomas
6885eb5fc9
temporarily don't get file metadata
2023-04-22 03:55:25 -07:00
Brandon Thomas
100ad0da35
use public bucket client
2023-04-22 03:48:52 -07:00
Brandon Thomas
7010d56bc3
error handling json hydration
2023-04-22 03:44:10 -07:00
Brandon Thomas
b34371eef0
try to only parse payload if not empty string
2023-04-22 03:42:29 -07:00
Brandon Thomas
e6542438b5
create model storage directory
2023-04-22 03:29:26 -07:00
Brandon Thomas
287e3e5f0c
inference for local dev
2023-04-22 02:17:58 -07:00
Brandon Thomas
8fcb908af9
code compiles
2023-04-22 02:14:44 -07:00
Brandon Thomas
56e84f434f
forgot schema migrations
2023-04-22 02:05:44 -07:00
Brandon Thomas
925f2d78ae
more sane schema for voice conversion results (bucket storage)
2023-04-22 02:04:44 -07:00
Brandon Thomas
90219594bb
insert result record
2023-04-22 01:43:24 -07:00
Brandon Thomas
08e8560499
voice conversion result upload (WIP)
2023-04-21 23:27:20 -07:00
Brandon Thomas
9e38b9a2fc
progress on so-vits-svc inference
2023-04-21 23:12:24 -07:00
Brandon Thomas
e9a6320eab
so-vits-svc inference (wip)
2023-04-21 21:51:37 -07:00
Brandon Thomas
da05885d7d
don't upload duplicates
2023-04-21 05:54:10 -07:00
Brandon Thomas
ba9f716ff8
encode fewer bytes in inference jobs
2023-04-21 02:24:23 -07:00
Brandon Thomas
2633c5f0ef
clean up tokens in vc inference
2023-04-21 02:05:14 -07:00
Brandon Thomas
da805b4f1d
clean upload hashing, better error messages
2023-04-21 00:22:58 -07:00
Brandon Thomas
9eb75c7eba
list media uploads by session
2023-04-20 01:40:36 -07:00
Brandon Thomas
75607b3c12
tests, aspath
2023-04-20 00:27:37 -07:00
Brandon Thomas
ce69b1b055
filesys crate cleanup
2023-04-20 00:18:29 -07:00
Brandon Thomas
9ee7fdbac5
move endpoint
2023-04-19 01:18:07 -07:00
Brandon Thomas
67e3ecebc1
Voice conversion model list endpoint
2023-04-19 00:43:27 -07:00
Brandon Thomas
52db0b7796
python3.6
2023-04-18 15:46:08 -07:00
Brandon Thomas
15fa5a2bee
update image
2023-04-18 15:44:58 -07:00
Brandon Thomas
32babc99f0
update image
2023-04-18 12:47:58 -07:00
Brandon Thomas
bdac796e51
update tt2 legacy inference to support docker, etc, unfront config
2023-04-18 12:37:30 -07:00
Brandon Thomas
18c50af218
Add "Deepfake CNN" level
2023-04-16 02:54:57 -07:00
Brandon Thomas
62cbde94bc
anderson cooper voice config
2023-04-15 23:43:54 -07:00
Brandon Thomas
b2f9b44e96
uncommitted changes
2023-04-15 23:36:26 -07:00
Brandon Thomas
6a48a5372c
fix arg
2023-04-13 16:58:26 -07:00
Brandon Thomas
1b0368664a
update image
2023-04-13 19:53:37 -04:00
Brandon Thomas
6a83524fd9
switch from 'onnx' to 'infer' for checking model integrity
2023-04-13 16:48:14 -07:00
Brandon Thomas
233247f3c0
config path
2023-04-13 15:59:16 -07:00
Brandon Thomas
60045a01d0
fix command
2023-04-13 13:33:57 -07:00
Brandon Thomas
dc5dfd9831
update docker image
2023-04-13 13:24:07 -07:00
Brandon Thomas
7b36fc0b98
Update model check command (so-vits-svc), upgrade easyenv
2023-04-13 12:52:18 -07:00
Brandon Thomas
92e1d10809
wip so-vits-svc
2023-04-12 02:53:57 -07:00
Brandon Thomas
4a486cedd2
add so-vits-svc download type
2023-04-10 01:39:54 -07:00
Brandon Thomas
004cde84a7
move enum
2023-04-09 23:03:15 -07:00
Brandon Thomas
61b74500d8
codegen, a few enums
2023-04-09 22:55:21 -07:00
Brandon Thomas
8285826ed0
move where config lives
2023-04-09 20:16:13 -07:00
Brandon Thomas
03d0110ee6
ml docker image
2023-04-09 23:02:57 -04:00
Brandon Thomas
34517fbaff
fix build errors
2023-04-09 19:18:07 -07:00
Brandon Thomas
839f7885fb
try another path
2023-04-09 02:58:23 -07:00
Brandon Thomas
cee3ffb217
fix docker env vars
2023-04-09 02:29:22 -07:00
Brandon Thomas
90198252b8
nltk env var
2023-04-09 02:24:41 -07:00
Brandon Thomas
165130321f
try setting cache dir with docker now
2023-04-09 02:10:34 -07:00
Brandon Thomas
061c2c7b07
try to move cache dir again
2023-04-09 01:46:37 -07:00
Brandon Thomas
413960b6cf
actually pass env to popen
2023-04-09 01:37:33 -07:00
Brandon Thomas
cc4b7deaa9
huggingface cache dir
2023-04-09 01:27:50 -07:00
Brandon Thomas
8229a3cfb3
record entity token/type after job completes
2023-04-08 22:59:16 -07:00
Brandon Thomas
b461c7e8e7
make field optional
2023-04-08 21:03:07 -07:00
Brandon Thomas
c58f23c117
fixup inference-job
2023-04-08 20:52:51 -07:00
Brandon Thomas
048cc26b6b
fixup storyteller-web
2023-04-08 20:50:22 -07:00
Brandon Thomas
9b5508d8c0
fixup mysql queries
2023-04-08 20:41:10 -07:00
Brandon Thomas
a81428913d
migrate generic_inference_jobs to include better indices/foreign keys
2023-04-08 19:54:58 -07:00
Brandon Thomas
756c8e09ae
inference status endpoints
2023-04-08 18:49:59 -07:00
Brandon Thomas
5b97360724
update upload routes
2023-04-08 01:09:22 -07:00
Brandon Thomas
79ad78bdde
header to route TT2 requests to new worker
2023-04-06 22:00:44 -07:00
Brandon Thomas
311299105b
updated docker image
2023-04-07 00:48:24 -04:00
Brandon Thomas
9dad3a153c
ml repo update
2023-04-06 22:50:21 -04:00
Brandon Thomas
93157b50c8
vits inference command roughly done, need to test
2023-04-06 18:58:07 -07:00
Brandon Thomas
47fbc1704d
analytics
2023-04-06 16:48:31 -07:00
Brandon Thomas
efba106d3c
analytics query
2023-04-06 16:26:06 -07:00
Brandon Thomas
e340eee250
progress on VITS (WIP)
2023-04-06 16:02:01 -07:00
Brandon Thomas
73be1bbf05
git rid of dated enum, start work on VITS inference
2023-04-06 14:35:29 -07:00
Brandon Thomas
81306d1a56
(untested) route VITS tts to generic job type
2023-04-05 01:48:50 -07:00
Brandon Thomas
8e341f7a83
strongly typed tts model type
2023-04-05 01:21:31 -07:00
Brandon Thomas
1978e5e653
db index on tts_models.tts_model_type
2023-04-05 00:53:52 -07:00
Brandon Thomas
8eaaad9b55
fix path error
2023-04-04 15:01:04 -07:00
Brandon Thomas
082c284add
debugging
2023-04-04 14:47:15 -07:00
Brandon Thomas
a83e5ff224
logging
2023-04-04 14:25:50 -07:00
Brandon Thomas
abaaaf2fdb
dev
2023-04-04 14:12:33 -07:00
Brandon Thomas
3409689566
fix path handling, introduce another (smaller scope) filesystem crate
2023-04-04 13:59:21 -07:00
Brandon Thomas
84c0e42964
fmt
2023-04-04 12:53:09 -07:00
Brandon Thomas
b848c2b549
update docker image for appropriate cuda version
2023-04-04 15:50:06 -04:00
Brandon Thomas
85abbd8587
set python intepreter, fix path
2023-04-04 03:14:40 -07:00
Brandon Thomas
b844191db7
downloader image
2023-04-04 06:08:19 -04:00
Brandon Thomas
0267a4799d
fix a few errors with paths and quoting
2023-04-04 03:07:54 -07:00
Brandon Thomas
c50060b161
no vits download venv
2023-04-04 02:57:39 -07:00
Brandon Thomas
a508a843bd
root dir
2023-04-04 02:56:25 -07:00
Brandon Thomas
d0bad0c8fb
docker image for testing
2023-04-04 05:50:48 -04:00
Brandon Thomas
d2c99a7bad
configure download-job for VITS (wip)
2023-04-04 00:24:28 -07:00
Brandon Thomas
681d923ae0
Add 'vits' enum to tts model tables
2023-04-04 00:11:48 -07:00
Brandon Thomas
9e563a0640
VITS download WIP (nearly done)
2023-04-03 23:41:18 -07:00
Brandon Thomas
db30096cb9
rename module in inference-job
2023-04-03 21:43:42 -07:00
Brandon Thomas
76f9f5a850
Refactor download job, begin to work on VITS downloading
2023-04-03 21:37:07 -07:00
Brandon Thomas
3a0eafee11
report back on how to handle the upload
2023-04-02 21:34:38 -07:00
Brandon Thomas
9fbecd5568
enqueue vits uploads (in theory)
2023-04-02 21:21:16 -07:00
Brandon Thomas
b3dedfc5a8
WIP VITS uploads
2023-04-02 21:05:05 -07:00
Brandon Thomas
8ded313e7b
configure storyteller-web with more db (why so slow in dev?!)
2023-04-02 20:23:12 -07:00
Brandon Thomas
e305928b45
flexible docker image sha
2023-04-02 20:01:45 -07:00
Brandon Thomas
db48ee0fd8
mac frontend cors
2023-04-01 05:40:25 -04:00
Brandon Thomas
5beedcb5e3
add one color
2023-03-25 23:12:14 -04:00
Brandon Thomas
e43feeb700
add random avatar/color to several endpoints
2023-03-25 19:54:12 -04:00
Brandon Thomas
38dc835ff4
add to event feed
2023-03-25 19:33:59 -04:00
Brandon Thomas
62b19b2b0e
functions to generate random avatar + color
2023-03-25 19:04:37 -04:00
Brandon Thomas
b7b92f4419
reduce user tokens to a single list
2023-03-23 02:49:33 -04:00
Brandon Thomas
7ee7ff3875
split ipv4/ipv6 files
2023-03-23 02:44:28 -04:00
Brandon Thomas
29237d3ead
user tokens
2023-03-23 02:42:05 -04:00
Brandon Thomas
5afbfc0ec4
change troll sequences
2023-03-23 02:32:05 -04:00
Brandon Thomas
6e5a2d1789
more accounts
2023-03-23 02:13:07 -04:00
Brandon Thomas
13281ea3b1
more accounts
2023-03-23 02:10:36 -04:00
Brandon Thomas
98f80a68de
documentation on removed ipv6 bans (in cloudflare, not our code)
2023-03-23 01:55:34 -04:00
Brandon Thomas
075fcfb81e
unblock ipv6
2023-03-23 01:42:27 -04:00
Brandon Thomas
a8c45cfac2
more accounts
2023-03-23 01:40:56 -04:00
Brandon Thomas
f0a4f0a4f7
more ips / accounts
2023-03-23 01:09:24 -04:00
Brandon Thomas
3b78853d7c
new user tokens and ip addresses
2023-03-23 01:03:58 -04:00
Brandon Thomas
98b6bb34a7
lighten up on the troll text
2023-03-23 01:02:18 -04:00
Brandon Thomas
4d759719f6
more IPs and user tokens
2023-03-23 00:52:41 -04:00
Brandon Thomas
ac28ff8a39
start blocking 101soundboards IPs too
2023-03-23 00:50:03 -04:00
Brandon Thomas
43a33a00ee
gitignore
2023-03-23 00:43:27 -04:00
Brandon Thomas
8bbc490b61
ignore vim temp files
2023-03-23 00:43:01 -04:00
Brandon Thomas
168a476b72
user token + ip address troll bans
2023-03-23 00:28:00 -04:00
Brandon Thomas
2cebfbb3fc
more 101soundboards user tokens
2023-03-23 00:12:44 -04:00
Brandon Thomas
d57e070c8c
dedup
2023-03-22 23:58:06 -04:00
Brandon Thomas
bde6b4d562
more user tokens
2023-03-22 23:56:12 -04:00
Brandon Thomas
9cde097d38
more stupid accounts
2023-03-22 23:53:13 -04:00
Brandon Thomas
1d7d1ba194
more 101soundboards user tokens
2023-03-22 23:50:36 -04:00
Brandon Thomas
632cf5a710
more 101soundboards user tokens
2023-03-22 23:40:19 -04:00
Brandon Thomas
c2e287f6f4
more damned accounts
2023-03-22 22:55:26 -04:00
Brandon Thomas
844799e30e
more 101soundboards accounts
2023-03-22 22:49:38 -04:00
Brandon Thomas
c1bd8ed611
actually fix builds
2023-03-22 19:57:04 -04:00
Brandon Thomas
1466bca4d7
fix build
2023-03-22 18:32:36 -04:00
Brandon Thomas
12fdf24028
temp disable build
2023-03-22 18:28:24 -04:00
Brandon Thomas
cefb770340
codegen db
2023-03-22 16:49:24 -04:00
Brandon Thomas
e971ea98dc
fix troll bans
2023-03-22 16:47:10 -04:00
Brandon Thomas
9ab8b366e9
ban 101 soundboards
2023-03-22 16:24:23 -04:00
Brandon Thomas
96563fa345
add a means to ban user tokens (or disable the service in weird ways)
2023-03-22 16:05:09 -04:00
Brandon Thomas
67ab94664c
working locally
2023-03-22 15:34:02 -04:00
Brandon Thomas
99f1226115
I have to run this under Docker locally since it's ancient
2023-03-21 05:35:08 -04:00
Brandon Thomas
9c45a17b8d
new inference subprocess command
2023-03-21 05:18:07 -04:00
Brandon Thomas
2cf5a6f942
TTS inference almost working on generic-inference-job
2023-03-21 02:01:13 -04:00
Brandon Thomas
071928d7bf
port more TT2 logic
2023-03-21 00:49:21 -04:00
Brandon Thomas
b8442b54ee
cleanup
2023-03-21 00:18:39 -04:00
Brandon Thomas
530d891ce9
about to bolt on TT2
2023-03-21 00:11:42 -04:00
Brandon Thomas
972f119468
query tts model
2023-03-20 23:57:44 -04:00
Brandon Thomas
9004432620
generic inference jobs can be listed (hacky fix)
2023-03-20 23:42:23 -04:00
Brandon Thomas
81a3bc270b
fix generic job list query
2023-03-20 23:11:38 -04:00
Brandon Thomas
84fe5a5762
enqueue generic inference jobs for tt2
2023-03-20 22:28:59 -04:00
Brandon Thomas
a02934ca4e
Add routing column to inference jobs (wip)
2023-03-20 21:58:08 -04:00
Brandon Thomas
4ddcd43e33
remove a lot of garbage from inference-job
2023-03-20 20:04:49 -04:00
Brandon Thomas
37be0174af
put inference job back into "working"(?) order
2023-03-20 19:29:06 -04:00
Brandon Thomas
f2e314d168
make sure this gets put in the image
2023-03-20 19:23:54 -04:00
Brandon Thomas
3bd216f00d
rename crate, fix path handling, move some env vars
2023-03-20 19:21:58 -04:00
Brandon Thomas
dc5885114d
env internal crate - search multiple directories for env files
2023-03-20 18:59:43 -04:00
Brandon Thomas
47873497b8
comment APIs needed disambiguation
2023-03-18 18:18:45 -04:00
Brandon Thomas
554766bd2a
Don't load IP ban sets that are empty
2023-03-18 13:25:14 -04:00
Brandon Thomas
86382bf219
rename files for better sorting
2023-03-18 13:13:54 -04:00
Brandon Thomas
59b1e28a14
unban IP
2023-03-18 13:12:52 -04:00
Brandon Thomas
3f88a741c9
private model logging + fix(?)
2023-03-18 13:06:19 -04:00
Brandon Thomas
2efcba5da6
fix broken path
2023-03-18 13:00:19 -04:00
Brandon Thomas
b4718a2f13
block broken python script IP 104.251.211.22
2023-03-18 12:59:19 -04:00
Brandon Thomas
efbb0000f3
fix list comment route
2023-03-18 07:02:50 -04:00
Brandon Thomas
0280e6b706
let's not do this table just yet
2023-03-18 05:37:14 -04:00
Brandon Thomas
79d568ee14
codegen db
2023-03-18 04:51:35 -04:00
Brandon Thomas
85630390a0
route bindings, list endpoint
2023-03-18 04:33:53 -04:00
Brandon Thomas
215b727bc1
create comment, delete comment handlers (not tested)
2023-03-18 03:54:30 -04:00
Brandon Thomas
e29c0b4c68
edit comment query
2023-03-18 02:13:46 -04:00
Brandon Thomas
c81e6af507
fix codegen script
2023-03-18 01:35:40 -04:00
Brandon Thomas
98d30917e5
rename crate 'database_queries' -> 'mysql_queries' because sqlite
2023-03-18 01:19:15 -04:00
Brandon Thomas
e62e409857
refactor package directory structure
2023-03-18 01:11:10 -04:00
Brandon Thomas
417137a9a8
deprecate some crates
2023-03-18 01:07:01 -04:00
Brandon Thomas
0da1994f0c
101soundboards user tokens
2023-03-18 00:45:33 -04:00
Brandon Thomas
36d016c3c7
todo
2023-03-17 09:34:58 -04:00
Brandon Thomas
b22e978e54
cleanup tts authorization logic
2023-03-17 08:52:04 -04:00
Brandon Thomas
c387f47c97
(untested) disallow use of private models unless owner
2023-03-17 08:34:15 -04:00
Brandon Thomas
1a09676327
codegen db
2023-03-17 07:57:50 -04:00
Brandon Thomas
e516f85e5f
filter out models that are private/hidden
2023-03-17 07:54:57 -04:00
Brandon Thomas
e16b86d36e
analytics query for non-public tts models
2023-03-17 06:50:06 -04:00
Brandon Thomas
003a86cd31
delete comments
2023-03-17 06:42:04 -04:00
Brandon Thomas
ebf48e20be
list comments endpoint
2023-03-16 12:21:28 -04:00
Brandon Thomas
df2444ddc0
insert comment
2023-03-16 11:09:26 -04:00
Brandon Thomas
6b6a2ceeba
codegen
2023-03-16 10:42:46 -04:00
Brandon Thomas
80da0d9649
Add tts result audio path to result endpoint
2023-03-16 10:31:28 -04:00
Brandon Thomas
b8fd0486c7
Untested query for inserting audit log items
2023-03-16 10:25:47 -04:00
Brandon Thomas
12ffb2ded1
new token types: comments, audit logs
2023-03-16 09:36:13 -04:00
Brandon Thomas
f810256b9c
new table enums
2023-03-16 09:28:49 -04:00
Brandon Thomas
461030b681
new tables (WIP) for comments + voice survey
2023-03-16 09:03:56 -04:00
Brandon Thomas
a33ff3f060
20 trending english voices
2023-03-16 09:02:43 -04:00
Brandon Thomas
98736324dc
25 trending english voices
2023-03-16 09:01:57 -04:00
Brandon Thomas
89a6f36f1a
gitignore for windows
2023-03-13 20:33:31 -04:00
Brandon Thomas
ac5bcbdd16
aichatbot: handler for current level
2023-03-13 18:27:25 -04:00
Brandon Thomas
7566c0d71c
use strum and default for more maintainable options
2023-03-13 18:20:58 -04:00
Brandon Thomas
0ca007b6e7
add level option for AiChatbotSidecar
2023-03-13 18:09:28 -04:00
Brandon Thomas
cbe07e2b3e
move test function out of aichatbot-sidecar
2023-03-13 17:50:04 -04:00
Brandon Thomas
495c01c38c
Merge pull request #40 from storytold/bt-cache-session
...
cache sessions + purge cache on billing, edit profile, etc.
2023-03-12 05:19:28 -04:00
Brandon Thomas
ff22319c77
purge session cache with billing endpoints
2023-03-12 05:17:37 -04:00
Brandon Thomas
16f2d5557b
clear session cache when user is edited
2023-03-12 04:49:59 -04:00
Brandon Thomas
e5cdb84c52
correct cache key
2023-03-12 04:34:50 -04:00
Brandon Thomas
8079be9f7e
progress with generics
2023-03-12 04:25:44 -04:00
Brandon Thomas
2821240cc0
generic over executor types
2023-03-12 04:12:22 -04:00
Brandon Thomas
ae0522419a
this *should* work - need to work on non-pooled version
2023-03-12 03:11:33 -04:00
Brandon Thomas
46bb4274ca
work in progress session caching (redis)
2023-03-12 03:00:47 -04:00
Brandon Thomas
f2b6dc4349
Merge pull request #39 from storytold/bt-redis-cache-endpoint
...
Bt redis cache endpoint
2023-03-12 01:25:31 -05:00
Brandon Thomas
a395c04265
Delete cache when tts model is edited
2023-03-12 01:24:23 -05:00
Brandon Thomas
d3a4613cc9
cleanup closures, fail open to db
2023-03-12 00:04:25 -05:00
Brandon Thomas
bdca25cf4f
cache works!
2023-03-11 23:58:14 -05:00
Brandon Thomas
06a053b6d9
this compiles too
2023-03-11 23:43:39 -05:00
Brandon Thomas
4104ef0129
this compiles too
2023-03-11 23:33:29 -05:00
Brandon Thomas
0f076cbacd
work in progress redis caching (this compiles)
2023-03-11 23:21:39 -05:00
Brandon Thomas
817b2c01df
new redis ttl cache crate (untested)
2023-03-11 22:53:01 -05:00
Brandon Thomas
c06c47f02e
Merge pull request #38 from storytold/bt-fix
...
Bt fix
2023-03-11 21:57:42 -05:00
Brandon Thomas
23b0dafd6b
fix compile errors
2023-03-11 21:57:13 -05:00
Brandon Thomas
91e83c8b90
notes
2023-03-11 21:57:13 -05:00
Brandon Thomas
4a32ced9cd
Merge pull request #37 from storytold/cache-profiles-redis
...
cache user profiles with redis
2023-03-11 06:42:15 -05:00
Brandon Thomas
75014a673a
cache user profiles with redis
2023-03-11 06:41:51 -05:00
Brandon Thomas
52afa5462d
Merge pull request #36 from storytold/block-ips
...
block more IPs
2023-03-11 05:15:40 -05:00
Brandon Thomas
a826d54311
block more IPs
2023-03-11 05:15:09 -05:00
Brandon Thomas
4f38e4b20a
codegen
2023-03-11 03:44:54 -05:00
Brandon Thomas
6880efd2f0
Merge pull request #35 from storytold/bt-edit-mfactor
...
edit tts model m-factor (mods only)
2023-03-11 03:42:27 -05:00
Brandon Thomas
e372a4b5ec
edit tts model m-factor (mods only)
2023-03-11 03:41:59 -05:00
Brandon Thomas
f978f1b055
Merge pull request #34 from storytold/bt-inference-test-jobs
...
test requests bypass the model cache
2023-03-11 02:36:11 -05:00
Brandon Thomas
ee69e72661
test requests bypass the model cache
2023-03-11 02:35:50 -05:00
Brandon Thomas
6295fd9569
update queries codegen
2023-03-11 02:09:03 -05:00
Brandon Thomas
53d9d55036
re-build all the things
2023-03-11 01:13:39 -05:00
Brandon Thomas
7e236f1e81
tts job now conveys mel multiplier
2023-03-11 01:12:35 -05:00
Brandon Thomas
6b7370ee64
migrations for mel multiply factor
2023-03-10 23:49:52 -05:00
Brandon Thomas
406d2eb7af
rename paths
2023-03-10 05:54:56 -05:00
Brandon Thomas
1cfb3663e9
endpoint disablement filter allows adjustment of online endpoints
2023-03-10 05:50:00 -05:00
Brandon Thomas
aa24f781fb
remove old ip banlist filter
2023-03-10 04:33:22 -05:00
Brandon Thomas
3a2dad2027
more cleanup, organization, refactor
2023-03-10 03:08:29 -05:00
Brandon Thomas
814c04cdac
more cleanup
2023-03-10 02:59:54 -05:00
Brandon Thomas
c45a6da8a5
rid database_queries of container_common::anyhow_result
2023-03-10 02:55:57 -05:00
Brandon Thomas
a5b2028588
begin removing container_common stuff
2023-03-10 02:53:48 -05:00
Brandon Thomas
4a743bace1
New static IP filter + docker config includes
2023-03-10 02:45:36 -05:00
Brandon Thomas
5ef5d6832b
IP lists of attackers to ban
2023-03-10 02:28:35 -05:00
Brandon Thomas
0ebb1e398b
Directory to contain IP bans
2023-03-10 02:21:48 -05:00
Brandon Thomas
4be572c36b
refactor / organize top level directories
2023-03-10 02:13:16 -05:00
Brandon Thomas
97bea31b1d
load an entire directory of bans
2023-03-10 01:49:11 -05:00
Brandon Thomas
f3dd785331
load ip sets from file
2023-03-10 01:34:57 -05:00
Brandon Thomas
0d99c2fc08
new ip address filter middleware (wip)
2023-03-10 01:12:37 -05:00
Brandon Thomas
edba26a2db
cache leaderboard
2023-03-09 18:29:15 -05:00
Brandon Thomas
89a9448c9a
new caching logic for get pending tts counts
2023-03-09 18:16:02 -05:00
Brandon Thomas
d557c78123
new LRU cache to bypass expiry
2023-03-09 18:06:21 -05:00
Brandon Thomas
9ac7f33008
feature flag to control frontend tts queue refresh rate
2023-03-09 10:47:59 -05:00
Brandon Thomas
716e7923ff
Add IP addresses that attacked us
2023-03-09 02:19:51 -05:00
Brandon Thomas
ad389491a2
mark dummy service logs
2023-03-09 00:31:00 -05:00
Brandon Thomas
85b5e427b9
Wrap forwarded ip
2023-03-09 00:30:20 -05:00
Brandon Thomas
74d7b543f2
dummy service too
2023-03-08 21:10:09 -05:00
Brandon Thomas
2078bac70f
forwarded IP in logs
2023-03-08 21:09:47 -05:00
Brandon Thomas
2e0110b0d9
omfg I'm dumb
2023-03-08 20:49:59 -05:00
Brandon Thomas
80a32eedf3
default route
2023-03-08 20:37:54 -05:00
Brandon Thomas
539c5ae796
with and without compression (messy af hack)
2023-03-08 20:32:54 -05:00
Brandon Thomas
6440d519f9
build dummy service in docker image
2023-03-08 20:17:30 -05:00
Brandon Thomas
690f4f1064
dummy service for debugging
2023-03-08 20:16:35 -05:00
Brandon Thomas
a1e4ca35cd
configurable health check duration
2023-03-08 18:49:56 -05:00
Brandon Thomas
d93c0a5a8d
log dropped requests
2023-03-08 17:10:36 -05:00
Brandon Thomas
9cc5ce9a04
faster builds for outage
2023-03-08 16:53:15 -05:00
Brandon Thomas
202b6c4a97
always opt in health checkers
2023-03-08 16:32:09 -05:00
Brandon Thomas
71abf1caa2
fix the pushback filter for the global GKE load balancer
2023-03-08 15:31:52 -05:00
Brandon Thomas
de01d0fde7
protect another endpoint (tts model list) with flag
2023-03-08 15:10:57 -05:00
Brandon Thomas
bb5ef2a3fe
404 "None" job statuses from broken Python clients
2023-03-08 14:53:14 -05:00
Brandon Thomas
a8ab9c1265
Middleware to disable site with 429 global pushback
2023-03-08 14:44:08 -05:00
Brandon Thomas
2412e15868
add a followup github action step
2023-03-08 12:48:12 -05:00
Brandon Thomas
4b45924455
one more disk space report
2023-03-08 12:30:06 -05:00
Brandon Thomas
72ce767337
bump github actions caching plugin
2023-03-08 12:28:06 -05:00
Brandon Thomas
76c562bf2e
trying one more thing
2023-03-08 12:24:37 -05:00
Brandon Thomas
6ac8759aba
remove check of filesystem at root due to permissions on /proc
2023-03-08 12:23:45 -05:00
Brandon Thomas
3503a4527c
disable docker container build tests (for now - emergency)
2023-03-08 12:23:04 -05:00
Brandon Thomas
03160b73d4
Merge pull request #33 from storytold/bt-space-check
...
report disk usage
2023-03-08 12:15:42 -05:00
Brandon Thomas
601b786b06
report disk usage
2023-03-08 12:15:25 -05:00
Brandon Thomas
05503512d8
Merge pull request #32 from storytold/bt-space
...
attempt to fix github builds failing for space issues
2023-03-08 11:48:02 -05:00
Brandon Thomas
7db6f074b6
attempt to fix github builds failing for space issues
2023-03-08 11:47:31 -05:00
Brandon Thomas
e7ad3a34de
Merge pull request #31 from storytold/bt-ff
...
feature flag to disable tts queue length
2023-03-08 11:28:13 -05:00
Brandon Thomas
5ccd512a2a
feature flag to disable tts queue length
2023-03-08 11:27:42 -05:00
Brandon Thomas
c40333e2a2
Fixup sqlx offline query caching, fix failing tests, fix docker
2023-03-08 05:56:59 -05:00
Brandon Thomas
edcfc9ff9b
port final storyteller-web query out: enqueue infer w2l
2023-03-08 05:31:56 -05:00
Brandon Thomas
862be58f1a
port "assign/unassign tts category" out of storyteller-web
2023-03-08 05:14:34 -05:00
Brandon Thomas
8b08f2ba1d
port "edit w2l template" queries out of storyteller-web
2023-03-08 05:01:49 -05:00
Brandon Thomas
fe3f8dec6c
port "edit w2l result" queries
2023-03-08 03:30:09 -05:00
Brandon Thomas
8ae5d34074
port the two "edit tts result" queries
2023-03-08 03:14:54 -05:00
Brandon Thomas
89f8837706
port tts upload job status query
2023-03-08 01:05:35 -05:00
Brandon Thomas
03ed0b4c7b
analytics queries
2023-03-07 23:57:43 -05:00
Brandon Thomas
f1d8161481
port get pending w2l detailed stats out of storyteller-web
2023-03-06 20:03:43 -05:00
Brandon Thomas
2d20430f55
port tts inference stats from storyteller web
2023-03-06 19:56:26 -05:00
Brandon Thomas
e2b98491cb
port storyteller-web query: insert w2l template upload job
2023-03-06 19:21:14 -05:00
Brandon Thomas
910caa1000
port storyteller-web get w2l inference job status
2023-03-06 18:58:15 -05:00
Brandon Thomas
0e39999097
port query get upload w2l template status
2023-03-06 06:03:59 -05:00
Brandon Thomas
77779bc231
port insert tts upload job query
2023-03-06 05:47:51 -05:00
Brandon Thomas
898c22b9cc
port "edit category" out of storyteller-web
2023-03-06 05:28:17 -05:00
Brandon Thomas
96b80b35a5
port query: set w2l template mod approval
2023-03-06 05:16:22 -05:00
Brandon Thomas
d182f800f7
port query: inference job status
2023-03-06 05:07:43 -05:00
Brandon Thomas
60af92ea39
port storyteller-web query: pending w2l template list
2023-03-06 04:57:45 -05:00
Brandon Thomas
da8c164b40
port storyteller-web query: create category
2023-03-06 04:49:36 -05:00
Brandon Thomas
d304f40984
port useless query - should have just deleted this one
2023-03-06 04:41:05 -05:00
Brandon Thomas
8f0d347c38
move storyteller-web query: set user role
2023-03-06 04:27:34 -05:00
Brandon Thomas
73db1b1a49
move another storyteller web query: category soft delete
2023-03-06 04:18:58 -05:00
Brandon Thomas
97b7120ff8
move another storyteller-web query: ban user
2023-03-06 04:07:46 -05:00
Brandon Thomas
961c5cf43d
remove another storyteller-web query: upsert ip ban
2023-03-06 03:58:47 -05:00
Brandon Thomas
4c2c54bd74
Merge pull request #30 from storytold/bt-extract-queries
...
Bt extract queries
2023-03-06 02:05:03 -05:00
Brandon Thomas
c158097b42
move queries for public event feed out of storyteller-web
2023-03-06 02:01:46 -05:00
Brandon Thomas
1c9366da4b
remove another storyteller-web query : staff
2023-03-06 02:01:46 -05:00
Brandon Thomas
f648f7b714
port db query for toggle IP ban out of storyteller-web
2023-03-06 02:01:46 -05:00
Brandon Thomas
c3db6ce24a
remove another ip ban query from storyteller-web
2023-03-06 02:01:46 -05:00
Brandon Thomas
1910b6497c
get rid of storyteller-web list ip bans query
2023-03-06 02:01:46 -05:00
Brandon Thomas
ac90b89230
SQL codegen for MySQL + Sqlite
2023-03-02 05:46:53 -05:00
Brandon Thomas
70e6ba5aec
codegen db
2023-02-26 00:12:58 -05:00
Brandon Thomas
5af6a68de7
Random init news story progress - better for initial mix of stories
2023-02-24 04:21:26 -05:00
Brandon Thomas
19532388a3
work on selecting random stories to scrape
2023-02-24 04:05:03 -05:00
Brandon Thomas
27adc9f73e
gizmodo + kotaku in app scraping
2023-02-24 03:41:12 -05:00
Brandon Thomas
6d082f2b9e
Kotaku + Gizmodo RSS indexers
2023-02-24 03:18:00 -05:00
Brandon Thomas
2c86a4189c
kotaku scraper
2023-02-24 02:49:02 -05:00
Brandon Thomas
bf5b2b385e
CNN timestamps
2023-02-24 02:33:37 -05:00
Brandon Thomas
b7c73930b4
CNN timestamps
2023-02-24 02:20:36 -05:00
Brandon Thomas
f9d61a1482
Gizmodo scraper
2023-02-24 01:50:08 -05:00
Brandon Thomas
4799d3ceac
CBS News scraper
2023-02-24 01:21:29 -05:00
Brandon Thomas
696fd2bd8d
Add timestamp to theguardian scraper
2023-02-24 00:45:10 -05:00
Brandon Thomas
1cfb3bb715
TheGuardian scraper
2023-02-23 19:21:19 -05:00
Brandon Thomas
ccb36f7f6e
CLI utility to test parsing
2023-02-23 18:57:23 -05:00
Brandon Thomas
83a16f83e3
fix builds?
2023-02-23 17:19:16 -05:00
Brandon Thomas
8f9554be9f
try to fix builds again
2023-02-23 05:10:10 -05:00
Brandon Thomas
d987397586
fix builds?
2023-02-23 02:54:29 -05:00
Brandon Thomas
41e03feb85
more analytics queries
2023-02-23 02:15:04 -05:00
Brandon Thomas
5c8cab0d90
extra analysis query
2023-02-23 01:35:03 -05:00
Brandon Thomas
8f40db9a3e
return short news title in HTTP endpoint
2023-02-22 08:36:18 -05:00
Brandon Thomas
b0a7c953be
Try to remove stories that have TTS strokes
2023-02-22 08:29:06 -05:00
Brandon Thomas
a08bc3fa64
include outputs in table, cleanup bugs
2023-02-22 07:51:53 -05:00
Brandon Thomas
5d111f0a68
fix job queue state flow
2023-02-22 07:35:45 -05:00
Brandon Thomas
51a5571d84
new jobs: LLM title summary, LLM categorization
2023-02-22 07:28:04 -05:00
Brandon Thomas
95f2ec3e40
Add new status columns to list queries
2023-02-22 06:02:10 -05:00
Brandon Thomas
b511420c03
Refactor to group news story tasks by phase
2023-02-22 05:14:07 -05:00
Brandon Thomas
aeab9da077
Summary news title and categories DB migrations
2023-02-22 04:57:05 -05:00
Brandon Thomas
46452415fd
hanashi v3
2023-02-21 23:06:42 -05:00
Brandon Thomas
cecbc8e730
report headline image url
2023-02-20 05:41:59 -05:00
Brandon Thomas
1ba73c817c
Avoid empty scraped articles
2023-02-20 05:37:59 -05:00
Brandon Thomas
8395739500
save debugging info
2023-02-20 05:23:07 -05:00
Brandon Thomas
c537f09c8f
Image generation works!
2023-02-20 05:09:35 -05:00
Brandon Thomas
1e7de6bf36
hanashi v2, include cnn entertainment feed
2023-02-19 06:35:22 -05:00
Brandon Thomas
ab6e3ceb5a
get rid of ads
2023-02-19 06:21:11 -05:00
Brandon Thomas
896938b762
begin work on per-website greenlighting
2023-02-19 06:05:48 -05:00
Brandon Thomas
486960905d
Add web_content_type to news_stories and news_story_productions
2023-02-19 05:57:36 -05:00
Brandon Thomas
2a54d3aac9
switch voices at runtime
2023-02-18 06:58:13 -05:00
Brandon Thomas
10ac9fee82
GUI dropdown (non-functional), window size
2023-02-18 06:38:59 -05:00
Brandon Thomas
cab4840a61
Sigil value in API for UNREAL's sake. Ugh.
2023-02-18 03:04:07 -05:00
Brandon Thomas
68a3c123eb
Include all news stories if "recent" is an empty list
2023-02-18 01:19:41 -05:00
Brandon Thomas
582ce9aa93
more debugging
2023-02-18 01:13:27 -05:00
Brandon Thomas
eaeb864c1c
debugging for endpoints
2023-02-16 05:56:05 -05:00
Brandon Thomas
77d4bc3b75
working retry
2023-02-16 04:50:51 -05:00
Brandon Thomas
b6be95144c
FakeYou with backoff
2023-02-16 04:40:24 -05:00
Brandon Thomas
5ca4dd3600
use session cookie credentials instead, because API sessions broken
2023-02-16 03:53:00 -05:00
Brandon Thomas
294c3107b5
API token for channels
2023-02-16 02:41:45 -05:00
Brandon Thomas
2de7ce146f
increase sqlite "connections"(??) to improve performance
2023-02-16 02:28:53 -05:00
Brandon Thomas
f7ddd24325
Get next audio file in sequence
2023-02-16 02:26:48 -05:00
Brandon Thomas
1b1ed15f21
endpoint for random news story
2023-02-15 04:55:46 -05:00
Brandon Thomas
dc93602306
track audio durations in db
2023-02-15 04:04:21 -05:00
Brandon Thomas
2898f40ad1
Fix errors
2023-02-15 03:34:27 -05:00
Brandon Thomas
ced51c7f58
track extra metadata throughout production
2023-02-15 03:20:38 -05:00
Brandon Thomas
b208847ec8
insert news story, tighten up timings
2023-02-15 02:48:15 -05:00
Brandon Thomas
744656cfd9
remove imgui (we're not using it)
2023-02-15 01:33:22 -05:00
Brandon Thomas
a735d3e972
sequence length
2023-02-15 01:24:16 -05:00
Brandon Thomas
90aa091398
refactor tts_render_targets -> tts_render_tasks
2023-02-15 01:12:58 -05:00
Brandon Thomas
f8e7ae3ced
preproduction story finalization
2023-02-14 13:09:22 -05:00
Brandon Thomas
a1b8a22225
Download files
2023-02-14 12:47:23 -05:00
Brandon Thomas
0a0105410d
Get updated audio status
2023-02-14 05:13:57 -05:00
Brandon Thomas
69a79b76ea
seems to work better?
2023-02-14 04:26:53 -05:00
Brandon Thomas
809387958c
cleanup
2023-02-14 03:29:46 -05:00
Brandon Thomas
44f7824910
cleanup
2023-02-14 02:59:29 -05:00
Brandon Thomas
1e05dcb7e2
Add sequence order
2023-02-14 02:47:07 -05:00
Brandon Thomas
72bdea7d10
Record inference details
2023-02-14 02:22:00 -05:00
Brandon Thomas
c3981e8554
idempotency crate, FakeYou requests to infer work
2023-02-14 02:03:31 -05:00
Brandon Thomas
6b937b7cd0
FakeYou rendering *almost* works
2023-02-14 01:37:26 -05:00
Brandon Thomas
5be10ae87a
refactor/organize worker modules
2023-02-13 21:32:46 -05:00
Brandon Thomas
12f7e30047
fakeyou client
2023-02-13 21:25:43 -05:00
Brandon Thomas
a5e0c2ab01
reorganize analytics queries
2023-02-13 17:39:58 -05:00
Brandon Thomas
0764711439
pause controls for scraping
2023-02-13 17:12:12 -05:00
Brandon Thomas
969be4726c
easier concurrency atomic bools, add controls for pieces
2023-02-13 17:05:22 -05:00
Brandon Thomas
8244bac6e1
tweak timings
2023-02-13 04:52:41 -05:00
Brandon Thomas
1d173a74d5
split into paragraph heuristic
2023-02-13 04:34:24 -05:00
Brandon Thomas
3786a64eb1
text splitting
2023-02-13 03:49:01 -05:00
Brandon Thomas
cc6cf0d6c0
"add dragon", as old colleagues would say
...
Maybe one day we can afford to buy Nintendo. (That's crazy.)
2023-02-12 22:53:56 -05:00
Brandon Thomas
144df6ffc0
refactor to make llm rendition a part of production flow
2023-02-12 17:52:18 -05:00
Brandon Thomas
85e0ce4b4a
Greenlighting stories + production workflow (abstract, but will use)
2023-02-12 15:54:26 -05:00
Brandon Thomas
107d11f0f9
Analysis of paying subscribers
2023-02-12 02:40:11 -05:00
Brandon Thomas
7efb65ae08
new tables
2023-02-10 21:26:14 -05:00
Brandon Thomas
ba3ff9768a
WIP - tables for stories
2023-02-10 06:28:55 -05:00
Brandon Thomas
b8e37d2e77
mark jobs done
2023-02-10 03:49:45 -05:00
Brandon Thomas
5a1e61b692
add some filters
2023-02-10 01:16:51 -05:00
Brandon Thomas
19b57b9c1d
unused module
2023-02-10 00:41:57 -05:00
Brandon Thomas
6c33c31289
skip CNN video content
2023-02-08 05:13:45 -05:00
Brandon Thomas
b1bbfe21ec
OpenAI API calls
2023-02-08 03:36:41 -05:00
Brandon Thomas
5878224f7e
rendition schema
2023-02-07 22:40:35 -05:00
Brandon Thomas
5497b7c0aa
small refactor
2023-02-07 18:54:23 -05:00
Brandon Thomas
bc58b50408
shared title/image extractors
2023-02-07 17:50:58 -05:00
Brandon Thomas
ce17a3e1bf
CNN articles, shared extractors
2023-02-07 17:13:07 -05:00
Brandon Thomas
b8fe3a0e7d
fix pagination bugs
2023-02-07 03:04:04 -05:00
Brandon Thomas
d41cec6c90
cleanup log spam
2023-02-07 02:24:44 -05:00
Brandon Thomas
6a86f43a92
scraping appears to work
2023-02-07 02:18:00 -05:00
Brandon Thomas
65a7a46914
finish refactoring macros
2023-02-06 23:53:19 -05:00
Brandon Thomas
31eafed60d
refactor database enum macros
2023-02-06 23:51:30 -05:00
Brandon Thomas
6abbbaae01
list query, enum macros for web_scraping_targets (sqlite)
2023-02-06 23:46:22 -05:00
Brandon Thomas
82efbf4d1f
update docs
2023-02-06 22:10:12 -05:00
Brandon Thomas
b1cefa66d5
docs about windows setup
2023-02-06 22:09:03 -05:00
Brandon Thomas
7f5f578abd
ignore this mess
2023-02-06 21:58:47 -05:00
Brandon Thomas
0c574c31d6
update path
2023-02-06 18:42:31 -05:00
Brandon Thomas
393bc084d4
scope aichatbot to sqlite
2023-02-06 18:38:33 -05:00
Brandon Thomas
035faa0561
update launch script
2023-02-06 17:56:32 -05:00
Brandon Thomas
84e2bcd2c3
sqlite library for windows
2023-02-06 16:37:12 -05:00
Brandon Thomas
bc69ecbda5
start script for windows
2023-02-06 16:17:16 -05:00
Brandon Thomas
5f35323a5f
fixes for windows
2023-02-06 16:14:24 -05:00
Brandon Thomas
30c9f779bd
outline remaining work
2023-02-06 05:00:32 -05:00
Brandon Thomas
4f7d03a505
index cnn + techcrunch
2023-02-06 04:56:49 -05:00
Brandon Thomas
5a031b1b80
indexer flow
2023-02-06 04:49:28 -05:00
Brandon Thomas
d1b6facd95
worker threads
2023-02-06 04:46:10 -05:00
Brandon Thomas
79984058c0
Save webpage and scraping summary
2023-02-06 03:56:51 -05:00
Brandon Thomas
adc52cd01e
directory to persist html
2023-02-06 03:32:07 -05:00
Brandon Thomas
aad257a1b2
fully refactor "hashing" out of container_common
2023-02-06 03:18:53 -05:00
Brandon Thomas
b8d5a1fad1
hashing refactor
2023-02-06 03:06:01 -05:00
Brandon Thomas
f757b94eaf
refactor "hashing"
2023-02-06 03:02:23 -05:00
Brandon Thomas
8ff2408cbf
begin to work on persisting scraping
2023-02-06 02:47:21 -05:00
Brandon Thomas
01fa2f8d67
serde
2023-02-05 17:35:44 -05:00
Brandon Thomas
25b7024655
title, more fields
2023-02-05 17:32:29 -05:00
Brandon Thomas
f7b8423623
techcrunch parsing sort of works
2023-02-05 16:29:17 -05:00
Brandon Thomas
0f99360c20
the guardian
2023-02-05 05:54:25 -05:00
Brandon Thomas
fe606c1610
three techcrunch feeds
2023-02-05 05:28:39 -05:00
Brandon Thomas
201481f969
handle TechCrunch venture feed
2023-02-05 05:24:54 -05:00
Brandon Thomas
665cd83739
techcrunch scraping of RSS feed
2023-02-05 05:12:42 -05:00
Brandon Thomas
eefe48f8ca
CNN candidate articles via RSS + Sqlite inserts
2023-02-05 05:02:13 -05:00
Brandon Thomas
a1c5ef6eb2
add sqlite columns, move database
2023-02-05 03:44:02 -05:00
Brandon Thomas
2f4fe2dabc
Web scraping WIP
2023-02-05 03:36:17 -05:00
Brandon Thomas
d63a505b8b
comments in .gitignore, aichatbot diesel configs
2023-02-05 01:41:08 -05:00
Brandon Thomas
fb1bf9940e
move migrations dir
2023-02-05 01:32:34 -05:00
Brandon Thomas
d4de388bb6
new reserved usernames for channels
2023-02-05 01:21:57 -05:00
Brandon Thomas
a0a5c68086
Project outline
2023-02-04 18:24:45 -05:00
Brandon Thomas
ddb106a9af
reqwest, ingestion modules (wip)
2023-02-03 23:57:12 -05:00
Brandon Thomas
7c229ba59b
fix
2023-02-03 06:00:21 -05:00
Brandon Thomas
d1978298f0
unixy paths
2023-02-03 05:57:41 -05:00
Brandon Thomas
1dcf06b571
fix?
2023-02-03 05:50:37 -05:00
Brandon Thomas
8af2368f32
fix?
2023-02-03 05:46:29 -05:00
Brandon Thomas
79fba33aae
more debugging
2023-02-03 05:44:38 -05:00
Brandon Thomas
bff0f9181d
debugging
2023-02-03 05:42:27 -05:00
Brandon Thomas
bd8f2570e2
report audio filename
2023-02-03 05:37:29 -05:00
Brandon Thomas
74c289b338
refactor sidecar, save dir
2023-02-03 05:17:09 -05:00
Brandon Thomas
63bb0e7253
cursor
2023-02-03 03:45:17 -05:00
Brandon Thomas
4140d07924
OpenAI API calls
2023-02-03 02:09:55 -05:00
Brandon Thomas
aa03abd3b5
Merge pull request #28 from storytold/saj-unsubscribe-reason
...
endpoint for indicating why a user is unsubscribing
2023-02-03 01:33:54 -05:00
Paul Sajna
fb8142fb49
endpoint for indicating why a user is unsubscribing
2023-02-02 22:25:00 -08:00
Brandon Thomas
362f41cbf3
Webserver + Egui synced
2023-02-02 17:55:04 -05:00
Brandon Thomas
a79d3bcf9a
fix windows builds?
2023-02-02 16:17:01 -05:00
Brandon Thomas
41e7780fa0
fix builds ?
2023-02-02 15:57:22 -05:00
Brandon Thomas
329e7defc5
update paths
2023-02-02 15:54:41 -05:00
Brandon Thomas
6ce0437aa2
ignore some code from Github language statistics
2023-02-02 15:52:33 -05:00
Brandon Thomas
34bb2c5266
ACTUALLY YOU CAN LAUNCH ACTIX FROM ANOTHER THREAD
2023-02-02 15:41:56 -05:00
Brandon Thomas
2b50d2bce5
new lib: actix_helpers (RouteBuilder), --gui, etc.
2023-02-02 15:33:01 -05:00
Brandon Thomas
c9f55fbb7c
Still issues with launching a gui on non-main thread; add fonts
2023-02-02 12:22:53 -05:00
Brandon Thomas
2da4971ec7
analytics query adjustments
2023-02-02 11:56:53 -05:00
Brandon Thomas
2cd6a98259
egui wants to run on main thread; so does actix. ugh
2023-02-02 04:38:43 -05:00
Brandon Thomas
7ba765b89c
Setting up aichatbot-sidecar desktop program
2023-02-02 01:40:44 -05:00
Brandon Thomas
02d7495e54
kick this can down the road _again_
2023-02-02 00:43:59 -05:00
Brandon Thomas
088535cb5a
refactor/move "plugins" crate to pertain only to services
2023-02-02 00:40:01 -05:00
Brandon Thomas
4ef9ad35a7
fix migration dir config
2023-02-02 00:30:30 -05:00
Brandon Thomas
f80f2c8962
Move all SQL stuff into single directory
2023-02-01 23:53:49 -05:00
Brandon Thomas
98fb5758e5
I'll see myself out
2023-02-01 19:32:03 -05:00
Brandon Thomas
06f219a8af
more reserved names
2023-02-01 19:30:30 -05:00
Brandon Thomas
439527a504
more reserved words
2023-02-01 19:26:00 -05:00
Brandon Thomas
61e1cc62b6
analytics query
2023-01-30 01:20:06 -05:00
Brandon Thomas
633dfb5682
more queries
2023-01-29 20:58:03 -05:00
Brandon Thomas
8df0273ca8
more analysis
2023-01-29 20:17:50 -05:00
Brandon Thomas
41630e1fc5
paying user analytics
2023-01-29 20:09:28 -05:00
Brandon Thomas
40bc0cf883
never need 500 voices in analytics
2023-01-27 02:33:00 -05:00
Brandon Thomas
7fdb5cfe9c
codegen db
2023-01-26 01:17:27 -05:00
Brandon Thomas
a0da010dab
Add model ratings to TTS list and get endpoints
2023-01-26 01:12:20 -05:00
Brandon Thomas
74ff632f4d
update TTS statistics on model rate
2023-01-26 01:12:20 -05:00
Brandon Thomas
e6d1f0db11
Alter tts_models to add ratings counts
2023-01-26 01:12:20 -05:00
Brandon Thomas
d190173f4d
new queries
2023-01-25 16:29:25 -05:00
Brandon Thomas
22e8a14170
Fix build errors and mistakes with user ratings
2023-01-25 16:24:44 -05:00
Brandon Thomas
b6fce130b5
GET and POST endpoints for user ratings
2023-01-25 16:08:22 -05:00
Brandon Thomas
1bb0dda330
Rating type instead of bool, upsert query, enums
2023-01-25 02:33:56 -05:00
Brandon Thomas
bcbb36a9ed
User ratings table
2023-01-25 00:47:35 -05:00
Brandon Thomas
dbfd80531d
analytics query
2023-01-23 23:21:44 -05:00
Brandon Thomas
4152b346c1
Server info endpoint to report backend SHA
2023-01-21 03:17:49 -05:00
Brandon Thomas
3b37cf9e89
analytics query
2023-01-20 06:22:40 -05:00
Brandon Thomas
c49bbd299a
analytics queries for category assignments
2023-01-20 05:42:54 -05:00
Brandon Thomas
993fe647b4
remove whitespace from TTS model titles
2023-01-20 03:27:39 -05:00
Brandon Thomas
d46778569c
Add Arabic and Turkish language support (serverside)
2023-01-20 03:25:17 -05:00
Brandon Thomas
2ea0e1450c
Sort tts models returned by category membership endpoint
2023-01-18 01:01:29 -05:00
Brandon Thomas
b31bafd639
split up heavy category endpoint into modules
2023-01-17 23:58:53 -05:00
Brandon Thomas
9246ab83cf
sort models in category flag
2023-01-17 21:39:23 -05:00
Brandon Thomas
93b06bd8b5
rename synthetic categories
2023-01-17 21:32:22 -05:00
Brandon Thomas
271bce9815
fix trending voices with hack
2023-01-17 07:28:10 -05:00
Brandon Thomas
f0bebc6135
ugh, docker typo
2023-01-17 06:39:00 -05:00
Brandon Thomas
98ce37d9a4
re-codegen db
2023-01-17 05:55:29 -05:00
Brandon Thomas
b0bc019db2
Merge pull request #27 from storytold/bt-trending-voices
...
Bt trending voices
2023-01-17 05:50:22 -05:00
Brandon Thomas
f3c34d9a7b
Trending voices / job
2023-01-17 05:49:23 -05:00
Brandon Thomas
98c8bbda57
Trending voices / analytics table
2023-01-16 16:28:17 -05:00
Brandon Thomas
18b20d6c4d
cleanup analytics queries
2023-01-16 16:15:42 -05:00
Brandon Thomas
11fd4881ea
re-codegen
2023-01-16 04:57:25 -05:00
Brandon Thomas
7ab39d0b5c
Merge pull request #26 from storytold/bt-categories
...
Work on synthetic categories; "latest models" category
2023-01-16 04:22:39 -05:00
Brandon Thomas
77e16d4bd8
synthetic categories
2023-01-16 04:21:19 -05:00
Brandon Thomas
58c7695a2a
Refactor enums
2023-01-16 01:56:38 -05:00
Brandon Thomas
140c93fc76
Work on categories
2023-01-16 01:37:24 -05:00
Brandon Thomas
2b58e3c32d
Emit server build SHA from /_status endpoint
2023-01-15 01:40:58 -05:00
Brandon Thomas
142adf10ee
ugh, that was stupid af
2023-01-15 01:24:39 -05:00
Brandon Thomas
d1698ead1d
fix build arg?
2023-01-15 01:24:03 -05:00
Brandon Thomas
2909e2dbb4
reintroduce GIT_SHA to container
2023-01-14 22:42:09 -05:00
Brandon Thomas
9015efdf9e
real world language header test
2023-01-14 20:20:41 -05:00
Brandon Thomas
2a5634503f
Reorganize tts category handlers
2023-01-14 19:07:57 -05:00
Brandon Thomas
623b82dd0e
fix accept-language for q-factor
2023-01-14 06:54:34 -05:00
Brandon Thomas
9fbafd7fcd
sqlx 0.4.x -> 0.6.x
2023-01-14 06:39:28 -05:00
Brandon Thomas
cc573fe242
return even less nonessential data
2023-01-14 04:32:07 -05:00
Brandon Thomas
c4225ce571
Cache computed TTS category assignments
2023-01-14 04:29:48 -05:00
Brandon Thomas
2f6747b98a
Merge pull request #25 from storytold/bt-serverside-category-memberships
...
Compute and cache TTS model category assignments serverside
2023-01-14 00:17:03 -05:00
Brandon Thomas
bc5090af54
Compute and cache TTS model category assignments serverside
2023-01-14 00:13:27 -05:00
Brandon Thomas
8062833e8d
gzip response payloads
2023-01-12 05:36:14 -05:00
Paul Sajna
e5a852acd6
remove rustup override from ci
2023-01-11 18:35:35 -08:00
Brandon Thomas
84ccda1960
default rustup to 1.66
2023-01-11 06:51:06 -05:00
Brandon Thomas
893a861d22
Bump to trigger rebuild (to test build caching)
2023-01-11 06:19:43 -05:00
Brandon Thomas
13b014e7fc
bump rust version?
2023-01-11 05:17:41 -05:00
Brandon Thomas
c8598bc9e3
Merge pull request #24 from storytold/saj-ci
...
CI MVP
2023-01-11 04:40:22 -05:00
Brandon Thomas
ecf84c4b15
Fix codegen (for reals), notes for mac, perform codegen
2023-01-11 04:31:25 -05:00
Paul Sajna
c4ea221c50
test
2023-01-11 00:37:09 -08:00
Brandon Thomas
8de1722466
fix migration script
2023-01-11 03:22:58 -05:00
Paul Sajna
a716b8963f
;)
2023-01-11 00:09:39 -08:00
Paul Sajna
7f70de0148
???
2023-01-11 00:06:50 -08:00
Brandon Thomas
bc033c2202
Merge pull request #23 from storytold/brandon-web-vc
...
Web-based Voice Conversion Part 1
2023-01-11 03:06:15 -05:00
Paul Sajna
756c357462
attempt to hide brandon's crimes
2023-01-10 23:57:53 -08:00
Paul Sajna
4b8c454c84
getting there?
2023-01-10 23:42:23 -08:00
Paul Sajna
d2b3386fea
urggggghhhhhhhh
2023-01-10 23:39:47 -08:00
Paul Sajna
f458f29109
urgggggh
2023-01-10 23:38:15 -08:00
Paul Sajna
aa3faca551
another test
2023-01-10 23:36:50 -08:00
Paul Sajna
2512810e81
another test
2023-01-10 23:35:25 -08:00
Paul Sajna
db629a6a0d
WIP for testing if github actions has mysql
2023-01-10 23:33:48 -08:00
Brandon Thomas
30202e6e5a
Fix build errors. This is largely because inference_job is not done
2023-01-11 01:39:48 -05:00
Brandon Thomas
9a263a01a1
more reserved words
2023-01-11 00:33:40 -05:00
Brandon Thomas
85ae704ab5
more analytics queries
2023-01-11 00:33:40 -05:00
Brandon Thomas
b128cdb3f5
inference job handlers
2023-01-11 00:33:40 -05:00
Brandon Thomas
8755e7a533
generic inference job queries
2023-01-11 00:33:40 -05:00
Brandon Thomas
9f873c33e7
Begin refactor of generic inference-job
2023-01-11 00:33:40 -05:00
Brandon Thomas
81302d0e1d
Payload for voice conversion inference records
2023-01-11 00:33:40 -05:00
Brandon Thomas
9e589c2b72
Refactor - db enum types into enums crate
2023-01-11 00:33:40 -05:00
Brandon Thomas
7a33c0721a
enqueue webvc inference work
2023-01-11 00:33:40 -05:00
Brandon Thomas
e1793d71b5
enqueue voice conversion request handler, media synthetic ids, ...
2023-01-11 00:33:40 -05:00
Brandon Thomas
5b20710f96
Upload file to GCS bucket
2023-01-11 00:33:40 -05:00
Brandon Thomas
77e1319b81
'crockford' crate, use crockford entropy for bucket
2023-01-11 00:33:40 -05:00
Brandon Thomas
8061880a83
consolidate upload handling, use new bucket paths
2023-01-11 00:33:40 -05:00
Brandon Thomas
651ed42b64
New 'buckets' crate for cloud storage uploads
2023-01-11 00:33:40 -05:00
Brandon Thomas
e870d6f4de
rename storage_buckets_common crate -> cloud_storage
2023-01-11 00:33:40 -05:00
Brandon Thomas
16a2e765ca
Handle video formats, too
2023-01-11 00:33:40 -05:00
Brandon Thomas
ee7626602a
Calculate duration for audio files without metadata
2023-01-11 00:33:40 -05:00
Brandon Thomas
533cd5e051
Tests + test data for media uploads
2023-01-11 00:33:40 -05:00
Brandon Thomas
7f51ccd01b
file size bytes
2023-01-11 00:33:40 -05:00
Brandon Thomas
f2bfcfeb75
audio codec/encoding
2023-01-11 00:33:40 -05:00
Brandon Thomas
603a678378
new errors crate, cleanup media duration calculation
2023-01-11 00:33:40 -05:00
Brandon Thomas
1ba3215881
organize media/files crates
2023-01-11 00:33:40 -05:00
Brandon Thomas
c4c5b89118
Calculate audio duration millis
2023-01-11 00:33:40 -05:00
Brandon Thomas
9aaee506ed
hash uploaded file
2023-01-11 00:33:40 -05:00
Brandon Thomas
ff12990b01
sort _types crates at the top
2023-01-11 00:33:40 -05:00
Brandon Thomas
45b7af9bd2
detect upload mimetype
2023-01-11 00:33:39 -05:00
Brandon Thomas
a34aedc375
move sqlx impls to reusable macro
2023-01-11 00:33:39 -05:00
Brandon Thomas
cb1e092ccd
tests on derived Display/Debug
2023-01-11 00:33:39 -05:00
Brandon Thomas
07d13a4ab5
proper case for enum mysql insert
2023-01-11 00:33:39 -05:00
Brandon Thomas
43c890b27c
Hack for sqlx to insert enums into varchar, but case still wrong
2023-01-11 00:33:39 -05:00
Brandon Thomas
a1510d45b2
Media uploads "working" from frontend. Need to handle file + upload
2023-01-11 00:33:39 -05:00
Brandon Thomas
32c7354798
Get rid of super legacy CreatorSetVisibility
2023-01-11 00:33:39 -05:00
Brandon Thomas
31bb03d9d3
Sayonara, RecordVisibility
2023-01-11 00:33:39 -05:00
Brandon Thomas
66bb76e60f
Goodbye, 'EntityVisibility'
2023-01-11 00:33:39 -05:00
Brandon Thomas
68f2e46540
more tests on enum types
2023-01-11 00:33:39 -05:00
Brandon Thomas
d08d3cd543
New 'enums' crate for db "enum-like" fields, composite keys, etc.
...
This should be useful for:
- Actual enum fields
- Enum-like char/varchar fields
- Composite keys, polymorphic record behavior, etc.
This should also define how these values are returned over the HTTP API
2023-01-11 00:33:39 -05:00
Brandon Thomas
e7fc93de86
Mild refactor: tokens, reusable_types under types/ directory
2023-01-11 00:33:39 -05:00
Brandon Thomas
deb3671be6
Endpoint for audio uploading
2023-01-11 00:33:39 -05:00
Brandon Thomas
8591f74ff2
Look at "started" w2l jobs too
2023-01-11 00:33:39 -05:00
Brandon Thomas
26587e51e3
More "analytics" (more operational) queries for w2l jobs
2023-01-11 00:33:39 -05:00
Brandon Thomas
2fad965446
"analytics" query to soft delete tts results for a given model
2023-01-11 00:33:39 -05:00
Brandon Thomas
c2f4c2c057
Fix hifigan (softvc) model check
2023-01-11 00:33:39 -05:00
Brandon Thomas
51350e6e5c
default parameters for local download job
2023-01-11 00:33:39 -05:00
Brandon Thomas
5f598dc516
Fix download-job queries and compile errors
2023-01-11 00:33:39 -05:00
Brandon Thomas
7bcde1e490
queries to handle softvc download (insert)
2023-01-11 00:33:39 -05:00
Brandon Thomas
13d00f6edf
partially handle softvc model downloads
2023-01-11 00:33:39 -05:00
Brandon Thomas
91695cde00
downloader job: handle softvc hifigan
2023-01-11 00:33:39 -05:00
Brandon Thomas
91ac868369
new download types
2023-01-11 00:33:39 -05:00
Brandon Thomas
60af0ea36d
enum refactor, whew
2023-01-11 00:33:39 -05:00
Brandon Thomas
46280c7877
3x voice conversion tables (models, results, synthetic_ids)
2023-01-11 00:33:39 -05:00
Brandon Thomas
08c2736ea4
More new tables: media_uploads, audit_logs
2023-01-11 00:33:39 -05:00
Brandon Thomas
02bf8808d0
Web + Job queries for generic_inference_jobs
2023-01-11 00:33:39 -05:00
Brandon Thomas
1de10d1b9f
Move all service/web/job projects into grouped subdirectories by type
2023-01-11 00:33:39 -05:00
Brandon Thomas
b649bb17c5
Web Voice Conversion
2023-01-11 00:33:39 -05:00
Brandon Thomas
587ea70d33
Merge pull request #22 from storytold/sajattack-kubernetes-localdev
...
Kubernetes localdev
2023-01-10 22:17:23 -05:00
Paul Sajna
ffd7793a8d
Update local_development_k8s.md
2023-01-10 19:12:27 -08:00
Paul Sajna
6e13777e84
docs?
2023-01-10 18:59:01 -08:00
Paul Sajna
b7fd9aa8d1
x86_64-unknown-linux-musl compatibility and volume mount
2023-01-10 18:59:01 -08:00
Paul Sajna
26e91bd990
database migration bugfix
2023-01-10 18:59:01 -08:00
Paul Sajna
61d0cbd385
clean up something I was trying that I no longer need
2023-01-10 18:59:01 -08:00
Paul Sajna
28d7a26d97
storyteller-web api runs successfully
2023-01-10 18:59:01 -08:00
Brandon Thomas
4196a6499b
fix download url check
2022-12-19 19:14:19 -05:00
Brandon Thomas
2cf07c1346
Block uploads of invalid video urls for w2l
2022-12-19 18:02:30 -05:00
Brandon Thomas
f56ea64dce
automate ubuntu setup
2022-12-15 03:59:28 -05:00
Brandon Thomas
5cfb3f50d7
codegen db
2022-12-13 20:52:41 -05:00
Brandon Thomas
5e0851eb09
fix session / loyalty plan test; mark legacy tokens deprecated
2022-12-13 18:42:18 -05:00
Brandon Thomas
0d3ffd3f3b
use DownloadJobToken throughout codebase
2022-12-13 18:26:45 -05:00
Brandon Thomas
1b60427ab0
Add UserToken-specific tests so we have a backup in case the macro fails
2022-12-13 18:05:35 -05:00
Brandon Thomas
75ede876d5
More tests
2022-12-13 17:46:46 -05:00
Brandon Thomas
086980318c
use enum variants for prefixes
2022-12-13 17:08:12 -05:00
Brandon Thomas
c4ca48f399
prefix registry
2022-12-13 16:50:23 -05:00
Brandon Thomas
ad88800b4e
enum variants to control character set
2022-12-13 15:43:19 -05:00
Brandon Thomas
64e3864140
Macro-defined tests "kind of" work.
2022-12-13 15:32:23 -05:00
Brandon Thomas
81757870ab
Crockford constructor
2022-12-13 02:22:23 -05:00
Brandon Thomas
2769a0b3f9
macro to implement common string token methods
2022-12-13 01:27:29 -05:00
Brandon Thomas
89e721e3bc
derive serde traits
2022-12-13 00:20:49 -05:00
Brandon Thomas
353aa4211b
more tests
2022-12-13 00:16:44 -05:00
Brandon Thomas
422e36b405
add tests
2022-12-12 23:54:09 -05:00
Brandon Thomas
110c7f828f
simplify UserToken type as a wrapper type
2022-12-12 23:16:44 -05:00
Brandon Thomas
b9e2c87025
use UserToken in an existing flow
2022-12-12 22:44:04 -05:00
Brandon Thomas
b1d5244620
WIP tokens crate
2022-12-12 22:34:08 -05:00
Brandon Thomas
7bcb576436
also track subscription status
2022-12-07 18:09:13 -05:00
Brandon Thomas
2e561acbb4
Analytics over top contributors, change loyalty plan slug
2022-12-07 18:05:40 -05:00
Brandon Thomas
c1860a0584
add powerstream to reserved usernames
2022-12-07 16:39:40 -05:00
Brandon Thomas
70140c0e7d
new slurs I just found
2022-12-07 16:38:27 -05:00
Brandon Thomas
cc56deb27c
UserBadge moved to reusable_types
2022-12-06 06:39:10 -05:00
Brandon Thomas
a15324adee
CORS separation by environments + tests
2022-12-04 02:40:28 -05:00
Brandon Thomas
fa108a5303
Add more german languages, fix failing test time bomb
2022-12-03 23:25:08 -05:00
Brandon Thomas
7193ddf18b
Fix codegen, codegen db, and update docs for dev db setup
2022-12-03 22:30:57 -05:00
Brandon Thomas
21e74c5367
Fix build error with tts-download-job
2022-12-03 17:46:50 -05:00
Brandon Thomas
11304d77cb
Italian TTS
2022-12-03 17:42:46 -05:00
Brandon Thomas
ba52695f35
root directory option for downloader
2022-12-01 21:52:52 -05:00
Brandon Thomas
d28fb07d6d
Clean up new consolidated downloader so it can be deployed
2022-12-01 21:44:32 -05:00
Brandon Thomas
740b419989
codegen script for download job and inference job
2022-11-27 16:56:45 -05:00
Brandon Thomas
8f2640c5eb
relabel docker image
2022-11-27 16:21:22 -05:00
Brandon Thomas
6e7c708374
Duplicate tts-inference-job into inference-job
2022-11-27 16:07:29 -05:00
Brandon Thomas
7b0066bea5
Bugfix; download-job handles TTS model download (locally tested)
2022-11-27 05:17:02 -05:00
Brandon Thomas
3d3dec1e23
download job can now handle tacotron (untested)
2022-11-27 04:37:49 -05:00
Brandon Thomas
1ac61b7748
GPU support for docker commands
2022-11-27 03:28:30 -05:00
Brandon Thomas
24c9cc2d08
subprocess stuff in its own lib
2022-11-27 03:10:01 -05:00
Brandon Thomas
2392062276
Download script works with docker image
2022-11-27 02:45:17 -05:00
Brandon Thomas
94c74eb9e0
Refactor download job to be easier to generalize
2022-11-26 21:44:41 -05:00
Brandon Thomas
7f5ccac55c
rename generic-download-job -> download-job
2022-11-26 20:41:13 -05:00
Brandon Thomas
62c4f2cbe0
Merge branch 'master' of github.com:storytold/storyteller-rust
2022-11-19 02:56:38 -05:00
Brandon Thomas
507f97bef5
note on subscription statuses
2022-11-18 05:27:53 -05:00
Brandon Thomas
a628e986e5
analytics query
2022-11-18 05:14:48 -05:00
Brandon Thomas
2fdd3b38ea
codegen
2022-11-17 21:45:02 -05:00
Brandon Thomas
a3234b3cb4
Add max_decoder_steps / max_duration_seconds to tts job
2022-11-17 21:41:16 -05:00
Brandon Thomas
dbf3d541e2
Production plans
2022-11-16 06:05:59 -05:00
Brandon Thomas
f690c73ebf
Force environmental plans
2022-11-16 05:42:18 -05:00
Brandon Thomas
567f3143d4
fix test failure
2022-11-16 04:16:42 -05:00
Brandon Thomas
2416056f6f
list subscriptions endpoint
2022-11-16 03:10:07 -05:00
Brandon Thomas
e390a7d1ac
fix endpoint to accept json
2022-11-16 01:28:23 -05:00
Brandon Thomas
00ab91b05c
new development stripe plan, minor method name refactor
2022-11-15 23:31:30 -05:00
Brandon Thomas
b403ed7c9e
Customer portal JSON handler
2022-11-15 19:07:42 -05:00
Brandon Thomas
049b0cf375
rename directory
2022-11-14 21:36:07 -05:00
Brandon Thomas
0e6657e9b7
fix short sha tagging?
2022-11-14 11:13:10 -05:00
Brandon Thomas
acdea58a81
tag with short SHA
2022-11-14 11:12:19 -05:00
Brandon Thomas
9711a60494
test build caching of leaf dependency
2022-11-14 05:51:02 -05:00
Brandon Thomas
8edbb3efda
revert dockerfile
2022-11-14 04:51:25 -05:00
Brandon Thomas
87b319b99a
tagging image again (this might work)
2022-11-14 04:46:49 -05:00
Brandon Thomas
ed6f19c2ab
test image tagging
2022-11-14 04:39:01 -05:00
Brandon Thomas
31fc96c356
attempt to tag image
2022-11-14 04:35:26 -05:00
Brandon Thomas
4b6eab5a1d
fix image name?
2022-11-14 04:33:31 -05:00
Brandon Thomas
6af1234095
attempt to fix github action build (temporarily broke dockerfile)
2022-11-14 04:31:18 -05:00
Brandon Thomas
8132a0bcb0
Attempt to use build caching
2022-11-14 03:55:57 -05:00
Brandon Thomas
c679aa3430
Clean up dockerfile, add notes
2022-11-14 03:07:19 -05:00
Brandon Thomas
33485670dd
Remove Python models (see storyteller-ml repo), rework Dockerfile
...
- TTS and W2L were moved to storyteller-ml. TTS has been hosted there
for a while, but W2L will need to be reworked.
- Restructure Dockerfile to remove old Python deps.
- Also begin using "cargo-chef". Unsure if this will work to speed things up.
2022-11-14 00:39:41 -05:00
Brandon Thomas
9008e7c044
codegen
2022-11-13 23:09:31 -05:00
Brandon Thomas
2d2a0b68ff
fix errors from last yolo-commit
2022-11-13 17:37:12 -05:00
Brandon Thomas
a211d45f26
on-prem worker stats
2022-11-13 16:42:18 -05:00
Brandon Thomas
d20d8a4c1c
Not a slur
2022-11-13 16:14:30 -05:00
Brandon Thomas
9aec48d237
placeholder
2022-11-07 12:47:38 -05:00
Brandon Thomas
e4835258cb
deletion queries
2022-11-02 23:24:35 -04:00
Brandon Thomas
f34fd6fc4c
re-codegen tts job queries
2022-11-02 23:02:20 -04:00
Brandon Thomas
413d1b7c1c
Merge pull request #21 from storytold/tts-job-debugging
...
Log failure metadata for TTS inference jobs
2022-11-02 22:54:25 -04:00
Brandon Thomas
fb99af8a23
Log failure metadata for TTS inference jobs
2022-11-02 22:51:47 -04:00
Brandon Thomas
23b0dab44f
re-codegen sqlx
2022-11-02 16:41:03 -04:00
Brandon Thomas
8ee5eca076
Add debugging info to tts_inference_jobs table; move app routes
2022-11-02 16:28:45 -04:00
Brandon Thomas
9a1df0cd8c
Merge pull request #20 from storytold/premium-tts
...
Premium tts
2022-11-02 05:28:54 -04:00
Brandon Thomas
5377cca3b1
TTS now has premium features
2022-11-02 04:36:19 -04:00
Brandon Thomas
badcb4b058
Migrations to add duration controls to inference jobs
2022-11-02 00:36:36 -04:00
Brandon Thomas
28a4f5ca8d
Merge pull request #19 from storytold/subscription-schema-migrations-2
...
Migrations to change/rename some columns
2022-11-01 23:39:23 -04:00
Brandon Thomas
3efe1afa48
Migrations to change/rename some columns
2022-11-01 23:33:59 -04:00
Brandon Thomas
d4a7c06f72
Merge pull request #18 from storytold/premium-plans-sessions
...
Premium plans sessions
2022-11-01 06:56:19 -04:00
Brandon Thomas
6b4d0b3ad1
Adding premium info to sessions
2022-11-01 06:39:59 -04:00
Brandon Thomas
23f6e74fd8
ugh, a gross refactor commit
2022-11-01 03:19:08 -04:00
Brandon Thomas
778d7eba7e
Premium plans + session changes
2022-11-01 01:54:07 -04:00
Brandon Thomas
e5db702289
SSL local dev instructions
2022-10-31 01:46:31 -04:00
Brandon Thomas
4eb400867a
Merge pull request #17 from storytold/url-configs
...
Url configs
2022-10-31 01:32:38 -04:00
Brandon Thomas
4584e9dbcf
Cors and local nginx configs for dev.fakeyou.com etc.
2022-10-31 01:31:46 -04:00
Brandon Thomas
2ca477fd8c
Better environment-based URL configuration
2022-10-31 00:07:34 -04:00
Brandon Thomas
13487a9046
Fix bug with upsert not changing the product key
2022-10-30 05:25:22 -04:00
Brandon Thomas
aff94446ac
Merge pull request #16 from storytold/stripe-customer-portal
...
Stripe customer portal (subscription cancellation / modification)
2022-10-30 05:04:36 -04:00
Brandon Thomas
15c9c1256b
Stripe customer portal (subscription cancellation / modification)
2022-10-30 04:57:10 -04:00
Brandon Thomas
009d0eab87
CLI crates
...
(was building a stripe tool, but need to remember to make DB tools)
2022-10-29 22:20:26 -04:00
Brandon Thomas
0d9a882f3f
Refactor stripe component modules
2022-10-27 04:36:43 -04:00
Brandon Thomas
4c878e332e
upgrade breaking transitive dependency?
2022-10-25 05:13:24 -04:00
Brandon Thomas
d22242ab69
Merge pull request #15 from storytold/product-integration-2
...
Continued work on product integration
2022-10-25 05:03:19 -04:00
Brandon Thomas
5ee51ed8e2
Continued work on product integration
2022-10-25 05:02:52 -04:00
Brandon Thomas
560448f1ad
Merge pull request #14 from storytold/product-integration
...
Integrate stripe / product crate
2022-10-24 23:03:27 -04:00
Brandon Thomas
1b40495ef3
Integrate stripe / product crate
...
Associates internal metadata with stripe subscription and better
composes both systems
2022-10-24 23:02:16 -04:00
Brandon Thomas
e8d376a3eb
Merge pull request #13 from storytold/premium-plans
...
Premium plan definitions
2022-10-23 00:44:34 -04:00
Brandon Thomas
8e6c02d1b1
Premium plan definitions
2022-10-23 00:43:53 -04:00
Brandon Thomas
4e4dbf0688
Premium plans config (just getting started on this)
2022-10-21 19:18:37 -04:00
Brandon Thomas
1ca54927d7
fix compile errors
2022-10-21 03:19:28 -04:00
Brandon Thomas
ddd29ada80
This appears to fix openssl!? Transitive dep update.
2022-10-21 03:17:00 -04:00
Brandon Thomas
5ef27bb86f
Merge pull request #12 from storytold/tts-failure-slowdown
...
Slow down jobs on repeated failures
2022-10-21 00:46:34 -04:00
Brandon Thomas
c03bdba0a6
Slow down jobs on repeated failures
2022-10-21 00:46:00 -04:00
Brandon Thomas
14432e9808
Fix build errors (couldn't run build on Linux due to SSL breaks)
2022-10-09 06:06:56 -04:00
Brandon Thomas
1204ac5399
Merge pull request #11 from storytold/desktop-app-api-stubs
...
Stub API for the desktop app
2022-10-09 05:47:39 -04:00
Brandon Thomas
468d2d1d75
stupid time bomb
2022-10-09 05:46:49 -04:00
Brandon Thomas
aac2af635b
Stub API for the desktop app
2022-10-09 05:45:11 -04:00
Brandon Thomas
90c96b5f50
codegen from mac (broken on Ubuntu?)
2022-10-09 04:47:32 -04:00
Brandon Thomas
207e63a5aa
Merge pull request #10 from storytold/echelon-stripe
...
merge incomplete arc of work
2022-10-09 03:50:06 -04:00
Brandon Thomas
399ed6cb2e
fscking sqlx and ubuntu 22.04 ssl - wtf
...
I can't link against Ubuntu 22.04 native tls
I can't get rustls to work
wtf
2022-10-09 03:48:23 -04:00
Brandon Thomas
d51d6720e6
Setup on a more modern Ubuntu
2022-10-09 02:58:16 -04:00
Brandon Thomas
8f807a7719
wip
2022-09-22 05:36:16 -04:00
Brandon Thomas
c8ba2d1863
include price, make adjustments to subscription product/price
2022-09-19 06:30:49 -04:00
Brandon Thomas
2f3cbd4523
handle terminated subscriptions
2022-09-19 05:16:56 -04:00
Brandon Thomas
cf7cd9945d
Handle grace period days
2022-09-19 04:39:51 -04:00
Brandon Thomas
6a2a99741e
cancel_at_period_end and new test
2022-09-19 04:35:59 -04:00
Brandon Thomas
dc115a7aa1
begin handling deleted subscriptions
2022-09-19 04:18:08 -04:00
Brandon Thomas
6ea1bf3226
handle events with idempotency by ignoring replays
2022-09-19 04:11:35 -04:00
Brandon Thomas
334fc3022e
record whether webhook events had actions taken, idempotency flag
2022-09-19 03:54:32 -04:00
Brandon Thomas
3fb26771de
subscription interval tracked
2022-09-19 03:35:30 -04:00
Brandon Thomas
ba448ccc50
record subscription billing periods, start date
2022-09-19 02:09:35 -04:00
Brandon Thomas
fd3081e440
Track status as an enum, don't update at terminal state
2022-09-19 01:36:01 -04:00
Brandon Thomas
66981c4d2c
Track subscription status
2022-09-19 00:26:16 -04:00
Brandon Thomas
c6a1fc18d6
coalesce nulls
2022-09-19 00:12:21 -04:00
Brandon Thomas
afb77393c0
Don't update on create if already existing, make user token optional
2022-09-19 00:02:52 -04:00
Brandon Thomas
a2e71d8944
Handle subscription update and create
2022-09-18 23:26:39 -04:00
Brandon Thomas
ca63e00905
user subscriptions
2022-09-18 19:52:11 -04:00
Brandon Thomas
faf689dc09
log more info from webhooks
2022-09-17 13:33:22 -04:00
Brandon Thomas
aec31779b8
store webhook logs
2022-09-17 13:02:10 -04:00
Brandon Thomas
452a3473b3
WIP schema
2022-09-17 12:06:21 -04:00
Brandon Thomas
00322c6ed4
tests
2022-09-12 06:53:16 -04:00
Brandon Thomas
6dd02d48c4
extractor
2022-09-12 06:33:20 -04:00
Brandon Thomas
2eaf7c499e
subscription extractor
2022-09-11 22:18:43 -04:00
Brandon Thomas
3b82e7a389
tests
2022-09-11 21:37:40 -04:00
Brandon Thomas
c825f17672
wip
2022-09-11 03:40:18 -04:00
Brandon Thomas
6bbf4453da
notes
2022-09-10 20:11:49 -04:00
Brandon Thomas
dda247b5ea
Handle payment intent success
2022-09-10 18:57:13 -04:00
Brandon Thomas
f0435804ec
one-time payment
2022-09-10 18:24:45 -04:00
Brandon Thomas
176feda73b
wip
2022-09-10 17:41:45 -04:00
Brandon Thomas
f81d40b5bb
Make logging less verbose
2022-09-10 05:42:50 -04:00
Brandon Thomas
c07f100986
wip
2022-09-10 04:26:24 -04:00
Brandon Thomas
9feded54bd
most of the events we want
2022-09-10 04:26:24 -04:00
Brandon Thomas
4acec068aa
asdhfahsdf
2022-09-10 04:26:24 -04:00
Brandon Thomas
e1d4c0f5f3
ugh, I hate this part of the project
2022-09-10 04:26:24 -04:00
Brandon Thomas
f066658c3c
Move in-progress Stripe / billing work to shared component crate
2022-09-10 04:26:24 -04:00
Brandon Thomas
17021f04b9
fml payments
2022-09-10 04:26:24 -04:00
Brandon Thomas
0e5b4599bb
stripe wip
2022-09-10 04:26:24 -04:00
Brandon Thomas
02e7d1f4fa
Stripe WIP
2022-09-10 04:26:24 -04:00
Brandon Thomas
360a389e3d
Add stripe payments support
2022-09-10 04:26:22 -04:00
Brandon Thomas
999d73db81
analytics queries
2022-09-10 00:53:25 -04:00
Brandon Thomas
ec1f5edd5c
on-prem analytics queries
2022-09-09 14:40:41 -04:00
Brandon Thomas
2bc00dd6ca
comment describing why to include this in the dockerfile
2022-09-09 14:11:08 -04:00
Brandon Thomas
6e6253bf86
dockerfile fixes?
2022-09-09 04:41:48 -04:00
Brandon Thomas
97e6fdc51b
Downgrade docker rust build Ubuntu 22.04 -> 20.04 for openssl bug
2022-09-09 04:01:43 -04:00
Brandon Thomas
3cb9afa074
Update Dockerfile to point to new base Rust image
2022-09-09 02:26:38 -04:00
Brandon Thomas
34d08bce61
Not sure what recently broke with the dockerfile. Print Rust versions
2022-09-09 01:25:49 -04:00
Brandon Thomas
3b3603d7cf
How did I forget to include the lock file? ugh.
2022-09-09 01:09:44 -04:00
Brandon Thomas
ab0180a591
Update s3 bucket client to respect timeout arg
2022-09-09 00:45:44 -04:00
Brandon Thomas
40e92a1b24
Use no-op Redis status logger optionally
2022-09-08 15:22:52 -04:00
Brandon Thomas
bf9bc013df
New dynamic job progress reporter with no-op version
2022-09-08 14:56:35 -04:00
Brandon Thomas
4a58f49d3d
kill pending jobs
2022-09-04 21:34:50 -04:00
Brandon Thomas
da7270e058
Queries to investigate service load, etc.
2022-09-04 19:22:02 -04:00
Brandon Thomas
420a2c8b40
fix gravatar test
2022-09-01 23:49:17 -04:00
Brandon Thomas
d1e261e633
no longer fail tests (timebomb bump)
2022-09-01 23:43:31 -04:00
Brandon Thomas
bfe4b8d090
Merge pull request #9 from storytold/echelon-billing-and-images
...
Pull user system into a reusable component library
2022-09-01 23:40:32 -04:00
Brandon Thomas
269145a395
codegen db
2022-09-01 23:38:51 -04:00
Brandon Thomas
22122046ce
We're not ready to perform this migrations
...
I'm being lazy and not pulling the relevant commits out of history
2022-09-01 23:35:43 -04:00
Brandon Thomas
4284aeced6
Substantial refactor: pull user system (except mod controls) into crate
...
This has been tested in storyteller-web to ensure it still works
2022-09-01 23:33:21 -04:00
Brandon Thomas
d047fa50a9
Successfully move one "user" endpoint into new package
2022-09-01 17:25:13 -04:00
Brandon Thomas
273b5f3c4e
Move SessionCookieManager to users component
2022-08-29 05:39:00 -04:00
Brandon Thomas
3477cc395b
refactor
2022-08-29 04:49:51 -04:00
Brandon Thomas
59f2c4a55d
service stub for image-generation-service
2022-08-29 00:56:38 -04:00
Brandon Thomas
84c616b6f6
New lib and service crates
2022-08-29 00:28:26 -04:00
Brandon Thomas
57e3dd05c7
generated image data
2022-08-28 19:52:01 -04:00
Brandon Thomas
2b52488bfa
generated images tables
2022-08-25 04:01:50 -04:00
Brandon Thomas
3d2f28431f
add credits tables
2022-08-23 13:09:20 -04:00
Brandon Thomas
f1c8364b72
First attempt at generic_workloads table
2022-08-23 10:32:09 -04:00
Brandon Thomas
bb8ba60829
Initial schema migrations for generated images + billing
2022-08-23 10:07:15 -04:00
Brandon Thomas
50d6537a73
report worker node name, if available
2022-08-18 03:01:06 -04:00
Brandon Thomas
e68b6dc72d
Merge pull request #8 from storytold/echelon-list-tts-single-connector
...
Use single connector with list TTS endpoint
2022-08-17 19:42:33 -04:00
Brandon Thomas
1da020abd4
Use single connector with list TTS endpoint
2022-08-17 19:41:30 -04:00
Brandon Thomas
db5af2c1f6
Merge pull request #7 from storytold/echelon-more-pooled-connections
...
Echelon more pooled connections
2022-08-16 21:59:28 -04:00
Brandon Thomas
68fec1c8da
leaderboard endpoint now uses connection pool (granted, not great)
2022-08-16 21:58:24 -04:00
Brandon Thomas
efe7248ce9
list_tts_model_categories endpoint now uses single connection from pool
2022-08-16 21:29:30 -04:00
Brandon Thomas
6dfe929655
list_tts_categories endpoint now uses single db connection from pool
2022-08-16 21:21:50 -04:00
Brandon Thomas
e86612af4b
session_info endpoint uses single pooled connection
2022-08-16 21:05:57 -04:00
Brandon Thomas
43f441693e
Update get_tts_models to use single pooled connection
2022-08-16 20:52:29 -04:00
Brandon Thomas
0fbc410baf
Merge pull request #6 from storytold/echelon-benchmarking
...
All queries to user profile controller use a single DB connection
2022-08-16 18:58:45 -04:00
Brandon Thomas
d393ecda34
All queries to user profile controller use a single DB connection
...
- Pull a single connection out of the pool and reuse it
- Update the benchmark code to handle ownership changes (previously,
I think everything was Sync/Send in the closures)
2022-08-16 18:49:25 -04:00
Brandon Thomas
88fb8f65e2
codegen
2022-08-16 02:37:42 -04:00
Brandon Thomas
623913d237
Merge pull request #5 from storytold/echelon-benchmarking
...
Echelon benchmarking
2022-08-16 02:30:17 -04:00
Brandon Thomas
70daacf559
Profile endpoint instrumented
2022-08-16 02:26:00 -04:00
Brandon Thomas
4bd0e09e7d
Move user profile query to query lib
2022-08-16 01:18:47 -04:00
Brandon Thomas
94ed34b5ba
Benchmarking library and begin implementation
2022-08-13 02:27:21 -04:00
Brandon Thomas
ed3554aeb0
parameterize number of mysql connections
2022-08-11 03:55:46 -04:00
Brandon Thomas
5b2a139da3
forgot to build it
2022-08-10 06:24:53 -04:00
Brandon Thomas
60f38c7f99
Forgot to copy built binary
2022-08-10 05:53:42 -04:00
Brandon Thomas
67b74e98ed
DB codegen
2022-08-10 04:44:58 -04:00
Brandon Thomas
2b73e38b15
Merge pull request #4 from storytold/echelon-hifigan-support
...
Echelon hifigan support
2022-08-10 04:40:18 -04:00
Brandon Thomas
4bc33ffea0
tts-inference-job uses custom vocoder (does not cache)
2022-08-10 04:33:38 -04:00
Brandon Thomas
df5e28ec94
query info about vocoders in tts-inference-job
2022-08-10 03:49:15 -04:00
Brandon Thomas
2a10ec5e70
Add custom vocoder info to TTS Model GET endpoint + query
2022-08-10 03:09:16 -04:00
Brandon Thomas
2f360a0475
Update model edit endpoint to include optional vocoder token option
2022-08-10 02:19:49 -04:00
Brandon Thomas
f6c33fc2a5
Migration to add vocoder token to TTS models
2022-08-10 02:02:52 -04:00
Brandon Thomas
3835093b51
GET vocoder endpoint
2022-08-10 01:41:15 -04:00
Brandon Thomas
1211262764
vocoder SELECT / get query
2022-08-10 00:57:39 -04:00
Brandon Thomas
419d6bc654
list vocoder endpoint
2022-08-10 00:36:53 -04:00
Brandon Thomas
f81b6091b3
queries / endpoints (WIP)
2022-08-09 22:06:36 -04:00
Brandon Thomas
28512b685e
Vocoder upload pipeline seems to work!
2022-08-09 22:06:36 -04:00
Brandon Thomas
8696613477
generic-download-job now running (need to test)
2022-08-09 22:06:36 -04:00
Brandon Thomas
962510f784
Fix storyteller-web build
2022-08-09 22:06:36 -04:00
Brandon Thomas
47b7c71cdb
WIP generic-download-job
2022-08-09 22:06:36 -04:00
Brandon Thomas
dbd7e949b7
WIP generic-download-job
2022-08-09 22:06:36 -04:00
Brandon Thomas
740ba1b2e4
simplify error responses
2022-08-09 22:06:36 -04:00
Brandon Thomas
08c05cbcf2
Schema changes, endpoints, routes, queries, etc.
2022-08-09 22:06:36 -04:00
Brandon Thomas
f8175d7666
reusable_types, WIP endpoints
2022-08-09 22:06:36 -04:00
Brandon Thomas
463a7479b9
Generic download job, hifigan model downloads
2022-08-09 22:06:36 -04:00
Brandon Thomas
425c0d3244
Merge branch 'master' of github.com:storytold/storyteller-rust
2022-08-09 22:05:58 -04:00
Brandon Thomas
3c4ef83876
IntelliJ spellcheck
2022-08-09 22:05:32 -04:00
Paul Sajna
53b4272792
Git build sha header ( #3 )
2022-08-06 00:23:35 -07:00
Brandon Thomas
4ef608720b
update readme
2022-08-04 04:40:22 -04:00
Brandon Thomas
078e2eeb9d
Mark vendored tests ignored that are failing in CI
2022-08-04 04:35:29 -04:00
Brandon Thomas
f837db9a89
Codegen DB for new job crates (post-refactor)
2022-08-04 04:20:56 -04:00
Brandon Thomas
bf26f7864f
Move last remaining jobs out of storyteller-web and into own crates
...
- w2l-inference-job
- w2l-download-job
These are now in their own independent crates, which should be easier to
do build caching on.
2022-08-04 04:15:55 -04:00
Brandon Thomas
421b38114c
Dockerfile cleanup
2022-08-04 03:44:41 -04:00
Brandon Thomas
174e51d6e1
Run all tests before build
2022-08-04 03:42:27 -04:00
Brandon Thomas
a36394238a
Fix a few broken tests, but this needs revisiting
...
- i18n means this module should be rewritten
- is Spanish even being handled correctly?
2022-08-04 03:10:42 -04:00
Brandon Thomas
76933402b5
Fix tests failing to build
2022-08-04 02:17:20 -04:00
Brandon Thomas
6fdd49514e
Fix broken vendored crate tests (see notes)
...
The vendored crate was updated from Tokio 0.2 to 1.0 in ec4816bd0
The tests remained broken.
This fixes the tests and is based in part on
https://github.com/PoiScript/newrelic-telemetry-sdk-rust/commit/f103d56898f599bf0d06e69d3ecc75147aa15d5e#diff-2e9d962a08321605940b5a657135052fbcef87b5e360662bb527c96d9a615542
2022-08-03 16:58:48 -04:00
Brandon Thomas
bc2d47ca17
update api token notes
2022-07-28 05:22:48 -04:00
Brandon Thomas
7a9e15d82e
Merge branch 'master' of github.com:storytold/storyteller-rust
2022-07-28 04:50:16 -04:00
Brandon Thomas
d8b701fe91
api tokens
2022-07-28 04:47:59 -04:00
Brandon Thomas
2490f7029f
api tokens
2022-07-28 04:42:52 -04:00
Brandon Thomas
db69ca9966
API token updates
2022-07-28 04:38:39 -04:00
Brandon Thomas
136f440f9e
API token for James
2022-07-28 04:12:58 -04:00
Brandon Thomas
ffcf1f5944
deleted models query
2022-07-28 03:06:26 -04:00
Brandon Thomas
fdf8a92cd8
analytics queries
2022-07-28 02:26:12 -04:00
Brandon Thomas
c17726ae40
Merge pull request #2 from storytold/debug-worker
...
ScopedTempDirCreator: this helps span filesystems
2022-07-28 02:10:10 -04:00
Brandon Thomas
cf7acace8c
ScopedTempDirCreator: this helps span filesystems
...
TempDir defaults to /tmp. Copies from this to other drives sometimes
fail, which is impeding local development
2022-07-27 23:14:33 -04:00
Brandon Thomas
95f15106f9
Merge pull request #1 from storytold/echelon-obscure-text-pipeline
...
Echelon obscure text pipeline
2022-07-27 23:12:55 -04:00
Brandon Thomas
2b9cde68e4
Obscure model text_pipeline_type
2022-07-27 23:12:23 -04:00
Brandon Thomas
6d79f91a0a
improve comments on text pipelines
2022-07-27 23:12:23 -04:00
Brandon Thomas
7c97e81830
new model analytics query
2022-07-27 03:11:21 -04:00
Brandon Thomas
d458d753fb
Cache W2L templates in-memory
2022-07-27 02:51:48 -04:00
Brandon Thomas
fc88730386
Fix tts job count query
2022-07-25 04:49:36 -04:00
Brandon Thomas
59b9143012
codegen
2022-07-25 02:47:29 -04:00
Brandon Thomas
61dd01e5c2
Add endpoint to expose pending TTS jobs publicly to the UI
2022-07-25 02:44:47 -04:00
Brandon Thomas
101d145709
Query pending TTS job count (public use)
2022-07-25 02:19:30 -04:00
Brandon Thomas
820417ac0f
More CORS domains
2022-07-25 01:57:41 -04:00
Brandon Thomas
b0cf63d75a
API token for 2.2M subs Twitch user IlloJuan
2022-07-15 04:59:21 -04:00
Brandon Thomas
9098ce38d6
Better downloads from Google Buckets. Atomic w/o race conditions.
2022-07-15 04:24:27 -04:00
Brandon Thomas
fe529c7088
TTS inference job now health checks the sidecar
2022-07-15 03:32:21 -04:00
Brandon Thomas
5a645b10a2
re-codegen
2022-07-14 20:05:10 -04:00
Brandon Thomas
b9fed6a933
Cache model lookups, removing some query load from DB
2022-07-14 20:03:32 -04:00
Brandon Thomas
3ae65f5d11
Add multi-item cache
2022-07-14 19:36:23 -04:00
Brandon Thomas
823cad0900
Cleanup warnings
2022-07-14 19:05:54 -04:00
Brandon Thomas
b807adc73d
Create "memory_caching" lib crate, start building more tools there
2022-07-14 19:03:22 -04:00
Brandon Thomas
7b07e85191
More cleanup
2022-07-14 18:49:22 -04:00
Brandon Thomas
17f82e78b2
Cleanup: get rid of unused imports in tts-inference-job
2022-07-14 18:45:01 -04:00
Brandon Thomas
a09f63537e
report how many usages there have been
2022-07-11 04:58:56 -04:00
Brandon Thomas
362e18b7d0
Ugh, path
2022-07-11 03:48:18 -04:00
Brandon Thomas
8edb385728
Add new handlers for design refresh flag cookie installation
2022-07-11 03:26:03 -04:00
Brandon Thomas
a04628147b
merge related analytics queries into one file
2022-07-11 03:03:19 -04:00
Brandon Thomas
ab549ab284
query improvement, fixes
2022-07-10 00:57:03 -04:00
Brandon Thomas
40a88bb04e
analytics query
2022-07-09 22:53:31 -04:00
Brandon Thomas
d4afc42d5c
Index on tts results creation date, query on popular models by date
2022-07-09 13:16:32 -04:00
Brandon Thomas
b71278aef1
Push rollout into the future to fix the pronunciation bug
...
We rolled this out as the default too soon. New models are trained on
10% arpabet only.
2022-07-06 18:55:15 -04:00
Brandon Thomas
39bffb527e
analytics queries
2022-07-06 18:51:20 -04:00
Brandon Thomas
cfa49edc49
re-codegen
2022-07-06 02:03:24 -04:00
Brandon Thomas
b801f7c19e
Edit TTS model with text pipeline type
2022-07-06 01:51:08 -04:00
Brandon Thomas
f75f55fa22
Use Rust Enum instead
2022-07-06 01:28:08 -04:00
Brandon Thomas
152a2bfad7
Move queries out of edit TTS model handler.
2022-07-06 00:08:36 -04:00
Brandon Thomas
03c6f1a269
Use HTTP inference arg for text_pipeline_type
2022-07-05 21:07:37 -04:00
Brandon Thomas
5a4be7a580
return text_pipeline_type and guess in TTS model GET endpoint
2022-07-05 18:17:19 -04:00
Brandon Thomas
2dd47cab86
Return a new endpoint-specific struct for tts models
2022-07-05 18:03:07 -04:00
Brandon Thomas
8aaa9dfceb
utilities for text pipeline determination
2022-07-05 17:52:08 -04:00
Brandon Thomas
46db3980d9
Add new tts_models column for text pipeline type
2022-07-05 16:00:46 -04:00
Brandon Thomas
8d56700860
report debug workers in logs
2022-07-05 02:31:09 -04:00
Brandon Thomas
db4c260e08
Fix build error
2022-07-03 23:10:12 -04:00
Brandon Thomas
f7880fca97
stop bad tts model download urls from jamming the system
2022-07-03 21:19:45 -04:00
Brandon Thomas
b7c7bd7452
Fix codegen (different Rust versions?) and re-codegen db
2022-07-03 20:14:11 -04:00
Brandon Thomas
7a883cdebb
Move tts-download-job into its own crate independent of storyteller-web
2022-07-03 20:07:43 -04:00
Brandon Thomas
a622e7a9e8
delete by status
2022-06-26 16:56:19 -04:00
Brandon Thomas
0646dbc8f6
cleanup
2022-06-25 11:36:17 -04:00
Brandon Thomas
b031e96ef2
Python needed to commit! Ugh!
2022-06-25 11:32:23 -04:00
Brandon Thomas
7c3aa0610a
Codegen new queries, fix codegen tool for new binary
2022-06-25 01:22:19 -04:00
Brandon Thomas
4106e4cfe2
Enqueue debug requests
2022-06-25 01:17:46 -04:00
Brandon Thomas
5a584bd6b4
Report tts result debug status
2022-06-25 00:58:07 -04:00
Brandon Thomas
ade3162e53
Save debug worker data to tts result record
2022-06-25 00:50:54 -04:00
Brandon Thomas
43824972e5
Worker can now query only debug jobs
2022-06-25 00:31:31 -04:00
Brandon Thomas
6b9e19c4a2
Split up TTS worker to make code easier to maintain
2022-06-25 00:13:46 -04:00
Brandon Thomas
04ba2b2954
minor: before running migrations, move is_debug_request column
2022-06-24 23:46:37 -04:00
Brandon Thomas
acfab87b5c
show percentage
2022-06-24 23:41:31 -04:00
Brandon Thomas
c5b04b51bc
debug worker migrations for tts jobs and results
...
This will let us set jobs to run on "debug" worker nodes.
2022-06-24 22:40:12 -04:00
Brandon Thomas
b9b8186e68
Utility to delete old tts_inference_jobs records
2022-06-24 22:00:48 -04:00
Brandon Thomas
78ea11bec0
Fix variable name
2022-06-21 05:33:20 -04:00
Brandon Thomas
46fa940f6d
Add clap and sidecar hostname param
2022-06-21 05:23:23 -04:00
Brandon Thomas
853f8c8e6a
tts-inference-job didn't need db queries module after all
2022-06-21 05:12:43 -04:00
Brandon Thomas
4f2c43ddaa
Pull tts-inference-job into own crate (almost working)
2022-06-21 05:10:05 -04:00
Brandon Thomas
a249c6a80e
Refactor job dependencies so we can move jobs to their own crates
2022-06-21 04:45:00 -04:00
Brandon Thomas
8e8a87ba51
Refactor CommonEnv into config crate
2022-06-21 03:43:21 -04:00
Brandon Thomas
5a79f20def
Move filesystem utils into container_common::
2022-06-21 03:19:59 -04:00
Brandon Thomas
367dbbb3b2
Disable newrelic flag
2022-06-21 02:46:17 -04:00
Brandon Thomas
7d3d7bc737
Delete cached models to clear up worker filesystems
2022-06-20 22:14:41 -04:00
Brandon Thomas
65cf697cb0
Attempt to enrich "filesystem full" errors for later handling
2022-06-20 21:28:28 -04:00
Brandon Thomas
0b554f0d0f
Clarify logging
2022-06-20 17:59:57 -04:00
Brandon Thomas
6b2b868745
Logging for TTS inference job
2022-06-20 17:32:26 -04:00
Brandon Thomas
0d096815f2
Update CORS for staging subdomains
2022-06-18 21:02:54 -04:00
Brandon Thomas
2648688873
codegen db
2022-06-14 00:43:36 -04:00
Brandon Thomas
956e44a452
report worker hostname for tts results
2022-06-14 00:23:05 -04:00
Brandon Thomas
9e1a401a39
TTS job log result token
2022-06-12 15:21:39 -04:00
Brandon Thomas
bda2ee592d
codegen db
2022-06-12 02:04:28 -04:00
Brandon Thomas
d65022a4cf
Rename column, track on-prem in worker code
2022-06-12 01:47:39 -04:00
Brandon Thomas
35d6de38d7
Add on-premise metadata columns to tts_results
2022-06-12 01:31:47 -04:00
Brandon Thomas
a9e551bea5
Add rate limiter configs for API consumers
2022-06-02 04:55:08 -04:00
Brandon Thomas
789d4b7607
French is officially supported
2022-06-01 17:56:54 -04:00
Brandon Thomas
e95e69e2ab
Merge branch 'master' of github.com:storytold/storyteller-rust
2022-06-01 15:54:59 -04:00
Brandon Thomas
8792b4c8ae
Add logging
2022-06-01 15:54:45 -04:00
Brandon Thomas
508b5467ca
Fix dockerfile to remove duplicate nvidia list files
2022-05-31 14:23:00 -04:00
Brandon Thomas
8df2e3c86e
fix dockerfile!?
2022-05-31 13:47:48 -04:00
Brandon Thomas
b80dc798bb
fix?
2022-05-31 13:35:57 -04:00
Brandon Thomas
9cfde5cdaa
correct url, distro, arch
2022-05-31 12:58:01 -04:00
Brandon Thomas
f0aed0cf5b
no sudo
2022-05-31 12:22:49 -04:00
Brandon Thomas
154cb86d0f
Fix NVIDIA broken docker packages
2022-05-31 11:47:29 -04:00
Brandon Thomas
7caf85a648
fix typo (ugh)
2022-05-31 11:05:25 -04:00
Brandon Thomas
2ac06d7f0b
codegen db
2022-05-31 10:18:30 -04:00
Brandon Thomas
08222f6e7e
stupid macbook keeps changing this due to case insensitivity
2022-05-31 10:17:20 -04:00
Brandon Thomas
2ad25bde37
high priority workers (untested, no sql codegen)
2022-05-31 10:15:32 -04:00
Brandon Thomas
ceac5c1f59
serde snake_case variants
2022-05-31 09:51:04 -04:00
Brandon Thomas
5bc337de37
API token
2022-05-27 12:13:18 -04:00
Brandon Thomas
3f0b356fd0
Another API token
2022-05-02 00:25:36 -04:00
Brandon Thomas
aebc0ffbee
add plan details to session endpoint
2022-05-01 23:58:15 -04:00
Brandon Thomas
198f0e6493
Config dir, add static API token (ugh), soon to be stripe configs
2022-04-29 12:17:19 -04:00
Brandon Thomas
784f768cb9
Actually, this token wasn't used/isn't going to be used
2022-04-28 02:47:10 -04:00
Brandon Thomas
65351d4831
API tokens
2022-04-28 02:37:33 -04:00
Brandon Thomas
cde1899804
API tokens
2022-04-28 02:13:01 -04:00
Brandon Thomas
9129a8eed2
re-codegen
2022-04-28 00:36:13 -04:00
Brandon Thomas
2cc4a06a10
Add API token note
2022-04-27 23:43:44 -04:00
Brandon Thomas
7234ad3d4b
integrate API tokens
2022-04-27 23:28:21 -04:00
Brandon Thomas
cb77e94776
Read API tokens from disk
2022-04-27 22:44:38 -04:00
Brandon Thomas
0d3528e18c
add common function to deserialize toml since we keep doing this
2022-04-27 17:55:54 -04:00
Brandon Thomas
f8bd7fb681
Begin work on statically configured API tokens
2022-04-27 16:37:58 -04:00
Brandon Thomas
70dccbe4fa
Merge branch 'master' of github.com:storytold/storyteller-rust
2022-04-27 14:55:33 -04:00
Brandon Thomas
2f6ac39f3e
Update README.md
2022-04-22 23:10:31 -04:00
Brandon Thomas
7b4c31e174
update name
2022-04-20 23:59:52 -04:00
Brandon Thomas
ceb3f8e559
Update README.md
2022-04-18 23:59:44 -04:00
Brandon Thomas
739363cfe7
Centralize priority level definitions
2022-04-08 04:16:17 -04:00
Brandon Thomas
90c1e1bebf
logging cleanup
2022-04-08 03:42:49 -04:00
Brandon Thomas
155294f29e
Now things look stable!
2022-04-08 03:15:56 -04:00
Brandon Thomas
2ddeee123f
switch to using internal pubsub
2022-04-08 00:05:26 -04:00
Brandon Thomas
2a4236f7aa
cleanup redis pubsub, need to work on killing the thread
2022-04-07 23:59:06 -04:00
Brandon Thomas
814de89cbe
Async pubsub finally works, and I think I can kill the thread
2022-04-07 23:35:00 -04:00
Brandon Thomas
36d61a999c
Killing the pubsub thread works now!
2022-04-07 19:40:54 -04:00
Brandon Thomas
35824b295e
Twitch TTS - Websocket thread subscribed to PubSub channel seems to work
2022-04-05 23:29:14 -04:00
Brandon Thomas
dfa3cd3074
starting to add new redis pubsub to websocket gateway
2022-04-05 17:22:47 -04:00
Brandon Thomas
6e682b8afe
better documentation
2022-04-04 21:28:47 -04:00
Brandon Thomas
dcac35f6be
Add storyteller.stream to CORS
2022-04-04 19:16:42 -04:00
Brandon Thomas
7cc3f12416
cleanup
2022-04-04 17:57:47 -04:00
Brandon Thomas
09033a3698
simplify informing PubSub service of active browser (share code)
2022-04-04 17:28:00 -04:00
Brandon Thomas
4cd9f63311
Migrations for twitch event timestamps (these were mistakenly omitted)
2022-04-04 01:44:52 -04:00
Brandon Thomas
f227978403
ignore temp script with secrets
2022-04-04 01:20:26 -04:00
Brandon Thomas
733dc728db
Twitch schema need work - I haven't had time to really dive into this yet
2022-04-04 01:20:04 -04:00
Brandon Thomas
f7c804c052
The twitch-websocket-gateway had an old binary referenced
2022-04-04 01:04:28 -04:00
Brandon Thomas
9da04516d3
Merge branch 'merge-more-old-code'
2022-04-04 00:46:35 -04:00
Brandon Thomas
f923fda09f
Merge and move twitter-vocodes-bot to old_code
2022-04-04 00:44:20 -04:00
Brandon Thomas
664d7c1c1c
Merge remote-tracking branch 'old_o/master' into merge-more-old-code
2022-04-04 00:43:26 -04:00
Brandon Thomas
df05ced4a7
merge and move discord-vocodes project to old_code/discord-vocodes-bot
2022-04-04 00:42:28 -04:00
Brandon Thomas
399e9aa6f2
Merge remote-tracking branch 'old_n/master' into merge-more-old-code
2022-04-04 00:41:17 -04:00
Brandon Thomas
ffc7df6140
Merge and move voder-proxy code into old_code/
2022-04-04 00:40:12 -04:00
Brandon Thomas
350ec18f1e
Merge remote-tracking branch 'old_m/master' into merge-more-old-code
2022-04-04 00:39:15 -04:00
Brandon Thomas
d7cf7caf66
Merge and move do-spaces-downloader to old_code/
2022-04-03 23:59:12 -04:00
Brandon Thomas
8a0c42ac66
Merge remote-tracking branch 'old_l/master' into merge-more-old-code
2022-04-03 23:58:15 -04:00
Brandon Thomas
2113b56154
Merge and move in twitch-tts-desktop-client (which was for unreal)
2022-04-03 23:57:01 -04:00
Brandon Thomas
f4e8e0c161
Merge remote-tracking branch 'old_k/master' into merge-more-old-code
2022-04-03 23:55:54 -04:00
Brandon Thomas
edf14416e0
Merge and move pubsub-enricher to old_code/pubsub-enricher
2022-04-03 21:30:08 -04:00
Brandon Thomas
51e9ea32eb
Merge remote-tracking branch 'old_j/master' into merge-more-old-code
2022-04-03 21:28:56 -04:00
Brandon Thomas
3c22ec5f82
Merge and move old twitch-ingestion-client (for unreal engine)
2022-04-03 21:26:57 -04:00
Brandon Thomas
21d8200c9e
Merge remote-tracking branch 'old_i/master' into merge-more-old-code
2022-04-03 21:25:42 -04:00
Brandon Thomas
df03f9c35b
Merge and move old twitter-ingestion-client (was to be for Unreal)
2022-04-03 21:23:25 -04:00
Brandon Thomas
5040ec8524
Merge remote-tracking branch 'old_h/master' into merge-more-old-code
2022-04-03 21:21:54 -04:00
Brandon Thomas
b9669aa7aa
Merge in and move old storyteller-protos project (which was for Unreal)
2022-04-03 21:18:54 -04:00
Brandon Thomas
d66975abb3
Merge remote-tracking branch 'old_g/master' into merge-more-old-code
2022-04-03 21:17:56 -04:00
Brandon Thomas
d7d09ffab5
Change github actions image name
2022-04-03 02:57:35 -04:00
Brandon Thomas
88691cfa2d
Move storyteller-web monorepo code back to directory root
2022-04-03 02:55:28 -04:00
Brandon Thomas
8c3f45b677
Move all old code into semantic directory names for easier use
2022-04-03 02:53:51 -04:00
Brandon Thomas
d5536ae307
Move old trumped/trumpet repo (it has useful phoneme stuff) to old_f/
2022-04-03 02:41:35 -04:00
Brandon Thomas
23602137a8
Merge remote-tracking branch 'old_f/master'
2022-04-03 02:39:04 -04:00
Brandon Thomas
f94bfa61c0
Notes update
2022-04-03 02:28:05 -04:00
Brandon Thomas
ffd0db90e9
move realtime-voice-conversion (once part of voder) to old_e/
2022-04-03 02:27:09 -04:00
Brandon Thomas
e6288e00e9
Merge remote-tracking branch 'old_e/master'
2022-04-03 02:26:14 -04:00
Brandon Thomas
58fa8e6d80
Describe merged code
2022-04-03 02:16:37 -04:00
Brandon Thomas
5326ffa290
Move old voder code (pieces still useful) into old_d
2022-03-31 20:15:36 -04:00
Brandon Thomas
b44f1229e2
Merge remote-tracking branch 'old_d/master'
2022-03-31 20:11:13 -04:00
Brandon Thomas
d6002cc10a
Update merge status
2022-03-31 19:45:12 -04:00
Brandon Thomas
6cb758a12d
Move cloudcam (zeromq + UnrealEngine) into old_c
2022-03-31 19:43:25 -04:00
Brandon Thomas
a8737ce0ae
Merge remote-tracking branch 'old_c/master'
2022-03-31 19:42:15 -04:00
Brandon Thomas
20607c5367
Re-introduce files from bd18ed9c09
2022-03-31 19:41:21 -04:00
Brandon Thomas
61dac586c6
Move cloudcam (green screen visual branch) into old_b/
2022-03-31 19:39:26 -04:00
Brandon Thomas
497d941746
This is what worked for the YC demo (zmq -> Unreal Engine)
2022-03-31 19:13:40 -04:00
Brandon Thomas
1a2dc43b4c
Merge remote-tracking branch 'old_b/green-screen'
2022-03-31 19:10:20 -04:00
Brandon Thomas
25b9bcf997
Instructions for merging
2022-03-28 23:32:37 -04:00
Brandon Thomas
89a3825564
green bg
2022-03-26 19:57:09 -04:00
Brandon Thomas
b89be75ab6
Move old storyteller-web project into new subdir
2022-03-26 19:32:02 -04:00
Brandon Thomas
7ebb3382d3
Merge remote-tracking branch 'old_a/master'
...
Following https://stackoverflow.com/a/14470212
2022-03-26 19:26:15 -04:00
Brandon Thomas
d68aae99f2
merging repositories and histories
2022-03-26 19:18:43 -04:00
Brandon Thomas
ef7227509e
add token
2022-03-25 23:33:57 -04:00
Brandon Thomas
4a72295eee
Add path to cookie
2022-03-23 22:54:04 -04:00
Brandon Thomas
340bedbcee
bah, wrong cookie domain
2022-03-23 19:06:23 -04:00
Brandon Thomas
732ade7540
Set cookie domain explicitly
2022-03-23 19:02:43 -04:00
Brandon Thomas
ff2bc5e4fa
Merge branch 'master' of github.com:storytold/storyteller-web
2022-03-23 12:25:54 -04:00
Brandon Thomas
67df72d669
http GET
2022-03-23 10:29:28 -04:00
Brandon Thomas
fa684466b2
new redirect url
2022-03-23 10:27:14 -04:00
Brandon Thomas
da8df046fe
more build errors, seriously wtf
2022-03-22 15:57:29 -04:00
Brandon Thomas
836536226f
fix build error with safe redirects (would have caught if mac not dumb)
2022-03-22 15:26:49 -04:00
Brandon Thomas
07923bb34f
twitch event logs schema wip
2022-03-21 23:55:59 -04:00
Brandon Thomas
4868d206af
this works!
2022-03-20 05:05:15 -04:00
Brandon Thomas
fcdee8628e
wip
2022-03-20 04:47:28 -04:00
Brandon Thomas
aa7d1906a9
partial fixes to ancient code
2022-03-20 04:25:28 -04:00
Brandon Thomas
838934880f
builder didn't match impl
2022-03-18 06:39:08 -04:00
Brandon Thomas
74d7f3c276
Investor mode: priority, cookie to enable
2022-03-18 06:02:42 -04:00
Brandon Thomas
f313d825de
Merge branch 'master' of github.com:storytold/storyteller-web
2022-03-18 05:28:27 -04:00
Brandon Thomas
c573a923b4
Add analytics queries
2022-03-15 23:56:04 -04:00
Brandon Thomas
db7e770513
begin work on logging schema for twitch
2022-03-13 23:58:04 -04:00
Brandon Thomas
8c1bf07a19
Merge branch 'master' of github.com:storytold/storyteller-web
2022-03-13 23:51:06 -04:00
Brandon Thomas
bd8ca1c831
Readme update
2022-03-12 20:57:22 -05:00
Brandon Thomas
0b9818cbcb
Updated instructions since unpacking this after 6 months didn't work
2022-03-12 17:23:10 -05:00
Brandon Thomas
86cd30e134
Update README.md
2022-03-11 23:58:03 -05:00
Brandon Thomas
3d696b71ee
Add two new EventResponse types: TtsCommandPreset, TtsCommandCustom
2022-03-10 23:37:36 -05:00
Brandon Thomas
c7fa4b65bc
document how to make CSV reports
2022-03-06 07:02:18 -05:00
Brandon Thomas
4734d20690
category list caching
2022-03-06 05:42:28 -05:00
Brandon Thomas
8d6a384ac7
health check query
2022-03-06 05:21:12 -05:00
Brandon Thomas
30929b051e
add health checking
2022-03-06 05:18:15 -05:00
Brandon Thomas
efe2bcd61d
rename fields correctly
2022-03-05 06:00:47 -05:00
Brandon Thomas
d7205ea3af
add more slurs. Thanks to bibby
2022-03-05 04:54:39 -05:00
Brandon Thomas
61ee753572
endpoint to kill running queries
2022-03-05 04:50:29 -05:00
Brandon Thomas
847805624e
more stats about jobs
2022-03-05 04:16:58 -05:00
Brandon Thomas
e945772c6a
codegen db
2022-03-03 03:00:35 -05:00
Brandon Thomas
e9b1a4ca8f
priority levels
2022-03-03 02:49:13 -05:00
Brandon Thomas
2f17465a84
job sorts by priority during, but has starvation prevention + env config
2022-03-03 02:00:32 -05:00
Brandon Thomas
1730da9caa
Multiple tiers of rate limiting
2022-03-03 01:12:50 -05:00
Brandon Thomas
95dc7617ff
minor stuff related to rate limit
2022-03-03 00:29:58 -05:00
Brandon Thomas
030b126a9c
tests around LFU
2022-03-02 20:32:09 -05:00
Brandon Thomas
91eae38e3b
aughhh usize
2022-03-02 19:45:55 -05:00
Brandon Thomas
95617e9c0c
max lfu models not used!
2022-03-02 19:32:05 -05:00
Brandon Thomas
f069d9e1f3
fix rules not applying!
2022-03-02 07:29:02 -05:00
Brandon Thomas
78efb11dbd
return username in oauth check
2022-03-02 06:54:43 -05:00
Brandon Thomas
9e55283b86
codegendb
2022-03-02 06:29:39 -05:00
Brandon Thomas
d2cc56940c
change oauth routes
2022-03-02 06:27:57 -05:00
Brandon Thomas
09cd602839
check oauth token existence
2022-03-02 06:20:10 -05:00
Brandon Thomas
5dfe83fe0f
add oauth token internal pk
2022-03-02 05:32:20 -05:00
Brandon Thomas
9dcc7665ff
Add internal token (dangerous, unsupported)
2022-03-02 05:17:06 -05:00
Brandon Thomas
e96b58afca
change default language from en-US to en
2022-03-01 07:05:16 -05:00
Brandon Thomas
b049450d35
codegen
2022-03-01 06:04:55 -05:00
Brandon Thomas
115aff8855
edit language tags, tts command
2022-03-01 05:47:03 -05:00
Brandon Thomas
252f0e1134
supported language tools
2022-03-01 05:13:27 -05:00
Brandon Thomas
a976d3e84d
add to another endpoint (get)
2022-03-01 04:32:13 -05:00
Brandon Thomas
41d5526c50
return new fields in list
2022-03-01 04:26:57 -05:00
Brandon Thomas
26bbbc412b
migrations for new columns: langauge, tts command
2022-03-01 04:06:33 -05:00
Brandon Thomas
e571c36f78
logging
2022-02-27 08:29:54 -05:00
Brandon Thomas
283a851a17
COOOORRRRS
2022-02-27 08:06:39 -05:00
Brandon Thomas
7b7417ae14
cors, nginx (still not working)
2022-02-27 06:37:40 -05:00
Brandon Thomas
c44dc209b3
more cors
2022-02-27 05:22:56 -05:00
Brandon Thomas
1ca99bdcaf
codegen db
2022-02-26 20:48:23 -05:00
Brandon Thomas
7a77207275
sort by rule order
2022-02-26 20:46:40 -05:00
Brandon Thomas
9633e7515a
fixed up, because upsert fails for rquired key
2022-02-26 06:38:55 -05:00
Brandon Thomas
e738d147e4
handler for reorder rules (untested)
2022-02-26 05:50:50 -05:00
Brandon Thomas
dfe902de4b
Begin work on "rule reorder", plus tests for unsafe query
2022-02-26 05:29:35 -05:00
Brandon Thomas
9b54e5b4be
validation of predicates and responses
2022-02-25 20:43:34 -05:00
Brandon Thomas
7e294d77d7
remove rule order from edit event (since this is awkward in isolation)
2022-02-25 20:29:17 -05:00
Brandon Thomas
65c821e394
bugfix
2022-02-25 04:26:35 -05:00
Brandon Thomas
bf97de31e0
more structured testing
2022-02-24 23:42:18 -05:00
Brandon Thomas
8ca4264afd
testing
2022-02-24 23:32:28 -05:00
Brandon Thomas
eff693692b
test data
2022-02-24 05:22:55 -05:00
Brandon Thomas
c4e1241966
better test data
2022-02-22 14:58:12 -05:00
Brandon Thomas
b237fe0f48
url fix, DELETE CORS
2022-02-22 05:25:04 -05:00
Brandon Thomas
75c9c2a00d
new "get" endpoint, changed URLs
2022-02-22 04:43:02 -05:00
Brandon Thomas
e517b393cf
test data
2022-02-22 03:26:18 -05:00
Brandon Thomas
b0df0a0e4f
fix event response serialization, make use of test script
2022-02-22 01:10:56 -05:00
Brandon Thomas
40a83e1bad
propagate type updates
2022-02-22 00:44:58 -05:00
Brandon Thomas
b59d7af915
EventResponse::NotSet also needs to be empty enum for proper json
2022-02-22 00:26:14 -05:00
Brandon Thomas
2c390ca20a
had to adjust "NotSet" enum for serialization
2022-02-22 00:16:26 -05:00
Brandon Thomas
c6fb2716fa
handle channel points events
2022-02-21 22:10:07 -05:00
Brandon Thomas
937f9d86a4
rule matching is much more robust
2022-02-21 17:40:56 -05:00
Brandon Thomas
38deee044f
mut cleanup
2022-02-21 15:30:26 -05:00
Brandon Thomas
4b0cd9c197
mut fixup
2022-02-21 15:27:40 -05:00
Brandon Thomas
ee387ce314
wip handlers (broken)
2022-02-21 04:00:48 -05:00
Brandon Thomas
480a2dc216
thread refactor
2022-02-21 00:00:01 -05:00
Brandon Thomas
844db3f6a8
split obs-gateway into websocket-gateway and twitch-pubsub-...
2022-02-20 23:31:09 -05:00
Brandon Thomas
8d2aad48aa
necessary for local dev
2022-02-20 20:05:41 -05:00
Brandon Thomas
bee4f25e2d
Local Dev SSL instructions for Linux (they work!)
2022-02-20 04:00:39 -05:00
Brandon Thomas
e47222ac29
add user token to twitch oauth (untested, stupid ssl)
2022-02-20 03:47:38 -05:00
Brandon Thomas
78623265df
query website settings from twitch job
2022-02-20 03:25:55 -05:00
Brandon Thomas
5a51a0ca39
hydrate on list too
2022-02-19 23:54:07 -05:00
Brandon Thomas
b726898119
comnplex types
2022-02-19 23:43:24 -05:00
Brandon Thomas
83aced2181
use complex types
2022-02-19 23:35:59 -05:00
Brandon Thomas
f1a9def628
event response and predicate
2022-02-19 22:34:59 -05:00
Brandon Thomas
8931c7175a
wip "complex models"
2022-02-19 14:18:30 -05:00
Brandon Thomas
361bfed6d6
re-codegen db
2022-02-19 13:50:40 -05:00
Brandon Thomas
e6f0908a3d
voice clone requests endpoints
2022-02-19 13:48:36 -05:00
Brandon Thomas
9280ec11f7
fix endpoint, debug script
2022-02-19 05:33:31 -05:00
Brandon Thomas
8e0a21421b
twitch event rule endpoints
2022-02-19 05:19:56 -05:00
Brandon Thomas
867e1c0ed5
huge re-codegen
2022-02-19 04:34:23 -05:00
Brandon Thomas
420a706f5d
massive in-library refactor
2022-02-19 04:03:45 -05:00
Brandon Thomas
c4b8e0912a
finally done of in-app 'database' module
2022-02-19 03:42:39 -05:00
Brandon Thomas
598e99d2da
refactor- almost done
2022-02-19 03:15:10 -05:00
Brandon Thomas
20a6839eaf
more refactor into mysql module
2022-02-19 02:45:41 -05:00
Brandon Thomas
c9b2d3ea10
continued refactor of db queries into lib
2022-02-19 02:25:11 -05:00
Brandon Thomas
8854366c12
more refactor into common lib
2022-02-19 02:05:43 -05:00
Brandon Thomas
17ff619f79
continued refactor into database_queries lib
2022-02-19 01:52:55 -05:00
Brandon Thomas
a468795294
more refactoring, getting rid of old enums
2022-02-19 01:32:39 -05:00
Brandon Thomas
bea8376066
more refactor
2022-02-19 01:23:55 -05:00
Brandon Thomas
fd272a853a
refactor: get rid of in-app database::enums module
2022-02-19 01:05:05 -05:00
Brandon Thomas
93c5ec0257
move w2l stats query
2022-02-19 00:36:35 -05:00
Brandon Thomas
e2c645a17c
Refactor: move rest of TTS queries into tts library crate
2022-02-19 00:31:40 -05:00
Brandon Thomas
30b484a92d
cleanup of in-app i8_to_bool, some derive_more, etc.
2022-02-18 21:53:25 -05:00
Brandon Thomas
0d3faf230d
make two queries a little more obvious
2022-02-18 20:54:11 -05:00
Brandon Thomas
62eff2ec82
query by user token
2022-02-18 20:51:40 -05:00
Brandon Thomas
71e8da44bf
queries for voice clone request insert / fetch
2022-02-18 20:47:56 -05:00
Brandon Thomas
6a4e967a70
Table for cloning voices
2022-02-18 20:08:42 -05:00
Brandon Thomas
de0bd9f09d
rule_is_enabled --> rule_is_disabled
2022-02-18 19:21:50 -05:00
Brandon Thomas
5b7d533dc3
cleanup
2022-02-18 19:17:21 -05:00
Brandon Thomas
cdc04b66d7
get twitch event rule for user
2022-02-18 19:14:24 -05:00
Brandon Thomas
1c3dbbe779
list twitch event categories
2022-02-18 19:02:29 -05:00
Brandon Thomas
416c32d166
update twitch event rule
2022-02-18 18:48:41 -05:00
Brandon Thomas
73de5d185c
Add API token internal token as foreign key
2022-02-18 18:34:27 -05:00
Brandon Thomas
d9039b9071
cleanup some compile warnings
2022-02-18 18:26:34 -05:00
Brandon Thomas
dcde6edba4
delete twitch event rule
2022-02-18 17:17:46 -05:00
Brandon Thomas
da6cbd5cfa
insert Twitch event rule
2022-02-18 17:02:55 -05:00
Brandon Thomas
ba1e61a78e
rename *again*, sort columns
2022-02-18 02:46:48 -05:00
Brandon Thomas
43160dd9e6
rename migration
2022-02-18 02:43:03 -05:00
Brandon Thomas
4b5c41e67d
add ip address columns
2022-02-18 00:38:40 -05:00
Brandon Thomas
05edf16847
update twitch tables with timestamp columns
2022-02-18 00:36:50 -05:00
Brandon Thomas
cb3c91f802
delete api token endpoint
2022-02-18 00:04:01 -05:00
Brandon Thomas
54ca8d4c7a
edit API token handler
2022-02-17 23:33:06 -05:00
Brandon Thomas
56ac627c4a
move vendor/ to crates/vendor
2022-02-17 21:54:54 -05:00
Brandon Thomas
b642a9a031
re-codegen
2022-02-17 05:10:42 -05:00
Brandon Thomas
84bbd3e2ca
Fix Gdown / Google Drive issue?
2022-02-17 04:46:34 -05:00
Brandon Thomas
0a3b99fc70
debug creation of API tokens
2022-02-16 04:13:59 -05:00
Brandon Thomas
653c282f07
API tokens migration, queries, and handlers (list, create)
2022-02-16 03:59:38 -05:00
Brandon Thomas
23e6f552e7
migrations for api tokens
2022-02-16 02:41:02 -05:00
Brandon Thomas
0507488ae1
index page update with microservice name (for local dev) + discord link
2022-02-13 21:35:41 -05:00
Brandon Thomas
64da009acb
Local dev configs for nginx (untested)
2022-02-13 21:24:52 -05:00
Brandon Thomas
70b6d1aa34
disable rule
2022-02-13 19:23:56 -05:00
Brandon Thomas
fed4bac5de
database connect (local dev)
2022-02-13 19:20:38 -05:00
Brandon Thomas
3528359d74
Twitch user configs (first iteration)
2022-02-13 19:20:23 -05:00
Brandon Thomas
e2eb288fa8
no more badge
2022-02-13 11:36:19 -05:00
Brandon Thomas
2a885c7758
cleanup a lot of unused imports that warned
2022-02-11 10:55:09 -05:00
Brandon Thomas
5df2416524
re-codegen db after new cols and refactors
2022-02-11 10:48:40 -05:00
Brandon Thomas
79e61b44af
edit featured tts model status
2022-02-11 10:47:28 -05:00
Brandon Thomas
701c0139f9
move query to db lib
2022-02-11 10:41:00 -05:00
Brandon Thomas
dd9733f9a8
Add featured TTS models (not yet done) + refactoring
2022-02-11 10:18:24 -05:00
Brandon Thomas
cf11c115f9
add raw inference text to inference job status
2022-02-11 07:45:07 -05:00
Brandon Thomas
0d52e96307
re-codegen
2022-02-10 23:40:01 -05:00
Brandon Thomas
262024ec28
Insert twitch and priority metadata
2022-02-10 23:25:55 -05:00
Brandon Thomas
93c8507386
error reporting
2022-02-10 23:12:56 -05:00
Brandon Thomas
6c131e2da1
additional cors for dev, fix twitch cheer case sensitivity
2022-02-10 03:14:20 -05:00
Brandon Thomas
cd297c1b36
note on linux issue
2022-02-10 02:08:08 -05:00
Brandon Thomas
c488773bc1
re-codegen db
2022-02-10 01:03:47 -05:00
Brandon Thomas
bf4e000644
Huge refactor of TTS job queries into database_queries common lib
2022-02-10 00:52:46 -05:00
Brandon Thomas
0fddc08868
Make Status an enum
2022-02-09 13:43:22 -05:00
Brandon Thomas
7394667f4a
begin moving these to database_queries crate
2022-02-09 13:34:09 -05:00
Brandon Thomas
765ecfb1db
a few more reservations
2022-02-09 12:42:46 -05:00
Brandon Thomas
67f93b84ac
add priority level to tts
2022-02-09 12:30:39 -05:00
Brandon Thomas
29f713c157
tts migrations with source metadata
2022-02-08 23:39:45 -05:00
Brandon Thomas
8f25491e78
Add language detection endpoint
2022-02-07 05:12:25 -05:00
Brandon Thomas
aa43554013
remove non-ASCII entirely
2022-02-07 01:20:26 -05:00
Brandon Thomas
820ac51190
add some emoji
2022-02-07 00:52:17 -05:00
Brandon Thomas
169739d617
comments
2022-02-07 00:23:46 -05:00
Brandon Thomas
3eb23cc3d7
more cleanup
2022-02-07 00:16:05 -05:00
Brandon Thomas
3cba684ddc
handle 5k occurrences
2022-02-07 00:06:45 -05:00
Brandon Thomas
cd70d7b06f
more buckets
2022-02-06 23:54:54 -05:00
Brandon Thomas
343f8a5b2b
split tests a bit
2022-02-06 23:52:25 -05:00
Brandon Thomas
7313a0d180
more conversions (hardly done)
2022-02-06 23:49:04 -05:00
Brandon Thomas
5cfde7b0f2
add more of latin extended-a
2022-02-06 23:16:46 -05:00
Brandon Thomas
26cabf3407
new tests (most failing)
2022-02-06 23:08:07 -05:00
Brandon Thomas
a1162d1e86
cleanup for legibility
2022-02-06 22:27:53 -05:00
Brandon Thomas
2cc117b04f
tests
2022-02-06 21:16:21 -05:00
Brandon Thomas
4e9919f5a2
more things to remove
2022-02-06 20:19:36 -05:00
Brandon Thomas
f0ea7be729
more characters to convert
2022-02-06 20:06:35 -05:00
Brandon Thomas
65db6a1041
table is simpler to read
2022-02-06 19:47:44 -05:00
Brandon Thomas
8b02351517
Share latin-to-ascii code/map
2022-02-06 19:38:57 -05:00
Brandon Thomas
a50554d4b7
More slurs to ban
2022-02-06 19:28:56 -05:00
Brandon Thomas
e56ac834ee
ban slurs with latin characters and upper case
2022-02-06 19:21:49 -05:00
Brandon Thomas
c25639baa4
Create user_input_common shared lib crate
2022-02-06 19:04:08 -05:00
Brandon Thomas
4e8c736814
forgot a few references to raw text
2022-02-06 17:52:46 -05:00
Brandon Thomas
ec4816bd00
Upgrade vendored newrelic-telemetry-sdk tokio 0.2 -> 1.0
2022-02-06 15:16:23 -05:00
Brandon Thomas
538568e963
more code points to convert
2022-02-06 02:05:34 -05:00
Brandon Thomas
d6097b66c3
more spanish characters
2022-02-06 00:22:41 -05:00
Brandon Thomas
fd589f85e8
latin tests
2022-02-06 00:04:31 -05:00
Brandon Thomas
ee6631f432
latin letters
2022-02-05 23:52:34 -05:00
Brandon Thomas
3df44a8d51
more characters to convert
2022-02-05 23:36:54 -05:00
Brandon Thomas
ee7634b9d0
unicode literals
2022-02-05 23:33:21 -05:00
Brandon Thomas
794010df9c
ellipsis
2022-02-05 23:14:28 -05:00
Brandon Thomas
b800ace754
fix tts inference for smart quotes
2022-02-05 23:03:51 -05:00
Brandon Thomas
0c29c4133e
a few more tests
2022-02-05 22:58:55 -05:00
Brandon Thomas
fa5c88ea1e
en dash / em dash
2022-02-05 22:56:21 -05:00
Brandon Thomas
75461a49df
new small crate to get rid of smart quotes, etc
2022-02-05 22:40:04 -05:00
Brandon Thomas
aa59e05d5b
optional serialization
2022-02-05 21:30:32 -05:00
Brandon Thomas
916a3f8abf
send pong
2022-02-04 10:21:27 -05:00
Brandon Thomas
8494a6c816
more debug logging
2022-02-03 22:58:09 -05:00
Brandon Thomas
f2e740133a
Fix redis panic (why is it okay in dev??)
2022-02-03 07:10:45 -05:00
Brandon Thomas
6c04d35ef1
add oauth grouping token last minute
2022-02-03 04:51:12 -05:00
Brandon Thomas
7cbede9d3d
re-codegen
2022-02-03 03:36:22 -05:00
Brandon Thomas
89ee7f6606
cleanup
2022-02-03 03:35:04 -05:00
Brandon Thomas
e5cd8164c3
fix URLs
2022-02-03 03:24:10 -05:00
Brandon Thomas
05db14bfbd
fixup query errors, add second redirect url
2022-02-03 03:13:30 -05:00
Brandon Thomas
9693bf7704
add all oauth scopes to mysql (untested, kind of dumb)
2022-02-03 02:48:50 -05:00
Brandon Thomas
24701aa9a8
Move Twitch OAuth onboarding to storyteller-web
2022-02-03 00:38:40 -05:00
Brandon Thomas
c30fbfbf82
SQLX db codegen / cache failed (??), this should fix it
2022-01-31 22:43:50 -05:00
Brandon Thomas
c6656aa417
Send to frontend
2022-01-31 16:53:37 -05:00
Brandon Thomas
2308d5f5d2
twitch secrets from env
2022-01-31 06:29:55 -05:00
Brandon Thomas
4b1aad995d
CORS: api.fakeyou.com
2022-01-31 06:20:06 -05:00
Brandon Thomas
1ed43fb510
codegen db
2022-01-31 06:15:12 -05:00
Brandon Thomas
7563f48f05
job token
2022-01-31 04:51:03 -05:00
Brandon Thomas
39ab109f19
move tokens::Tokens util for MySql to common lib crate
2022-01-31 04:45:25 -05:00
Brandon Thomas
69186282a0
inserts pending job
2022-01-31 04:36:26 -05:00
Brandon Thomas
99b642f7ac
insert tts job records (wip)
2022-01-31 04:24:17 -05:00
Brandon Thomas
1b5c3f6b3f
trim spaces
2022-01-31 03:43:52 -05:00
Brandon Thomas
313950f7b3
remove cheers from text
2022-01-31 03:25:23 -05:00
Brandon Thomas
db582ca7e7
Add twitch_common crate
2022-01-31 03:04:12 -05:00
Brandon Thomas
e363f90eba
Add new binaries to Dockerfile
2022-01-31 02:20:31 -05:00
Brandon Thomas
6cbcd7354c
codegen db
2022-01-31 02:02:28 -05:00
Brandon Thomas
3dbc1890da
fixup bugs
2022-01-31 02:01:54 -05:00
Brandon Thomas
6445244957
save both event types to db
2022-01-31 01:53:27 -05:00
Brandon Thomas
da5c1893b3
record channel bits event
2022-01-31 01:39:16 -05:00
Brandon Thomas
37851f8f53
channel points inserts
2022-01-31 00:46:44 -05:00
Brandon Thomas
3f889c6aad
adjust inserts
2022-01-30 14:14:31 -05:00
Brandon Thomas
4448a81ee5
insert bits (untested)
2022-01-30 03:51:53 -05:00
Brandon Thomas
6d6c7bc923
more schema
2022-01-30 02:11:27 -05:00
Brandon Thomas
e49f6f66df
migrations wip
2022-01-30 00:11:17 -05:00
Brandon Thomas
30d96a94c5
start adding docs
2022-01-29 23:49:03 -05:00
Brandon Thomas
103d9108b1
cheating on git commits again, hopefully the last time
2022-01-28 23:42:18 -05:00
Brandon Thomas
115fc2fe70
I'm cheating here...
2022-01-27 23:58:06 -05:00
Brandon Thomas
7f4cb37aea
schema wip
2022-01-26 23:32:32 -05:00
Brandon Thomas
ec67c123d2
empty migrations for bits/channel points
2022-01-25 23:57:38 -05:00
Brandon Thomas
9a05b91788
more notes
2022-01-25 04:16:14 -05:00
Brandon Thomas
80da30937e
channel points message
2022-01-25 03:48:05 -05:00
Brandon Thomas
427c1d2761
message with bits
2022-01-25 03:43:36 -05:00
Brandon Thomas
0edcf2b9c1
Fix refresh count
2022-01-24 18:32:46 -05:00
Brandon Thomas
228e312949
Add refresh_count to model
2022-01-24 00:50:22 -05:00
Brandon Thomas
2ed75e5b0f
cleanup
2022-01-24 00:34:47 -05:00
Brandon Thomas
2d9fa3bd2f
oauth renewal works
2022-01-24 00:34:02 -05:00
Brandon Thomas
7a23cb69fa
simpler without optionals
2022-01-24 00:23:21 -05:00
Brandon Thomas
aa8f483da0
error handling
2022-01-24 00:17:43 -05:00
Brandon Thomas
92b31bc2c5
this nonsense helps my poor ADHD
2022-01-23 23:57:26 -05:00
Brandon Thomas
245b3397a8
change order
2022-01-23 23:55:17 -05:00
Brandon Thomas
c86d8f81d3
cleanup (this might be a regression)
2022-01-23 20:33:03 -05:00
Brandon Thomas
95ef47459f
Token renewal, but broken. Need to reinit pubsub
2022-01-23 17:25:21 -05:00
Brandon Thomas
26f42889bf
plumb token refresher
2022-01-23 02:30:07 -05:00
Brandon Thomas
ca38a5d69d
add refresh token tool
2022-01-23 01:57:53 -05:00
Brandon Thomas
07b480ef26
begin work on token renewal
2022-01-23 00:59:37 -05:00
Brandon Thomas
1bff8de1a5
kill thread when OBS session goes away
2022-01-22 17:14:23 -05:00
Brandon Thomas
a9dbc7303c
cleanup
2022-01-21 23:43:51 -05:00
Brandon Thomas
2011f31e70
Check lease for expiry
2022-01-21 10:32:33 -05:00
Brandon Thomas
d4e90b9ec8
docs, logging
2022-01-21 10:11:09 -05:00
Brandon Thomas
dc3d3cc24a
update main thread to struct
2022-01-21 10:00:15 -05:00
Brandon Thomas
51f6e8229f
thread id stuff
2022-01-21 09:51:47 -05:00
Brandon Thomas
795f1a7b45
cleanup
2022-01-21 00:19:29 -05:00
Brandon Thomas
516eb12ecd
HOW DID THIS GET COMMITTED
2022-01-20 23:49:36 -05:00
Brandon Thomas
72b6924422
fix blocking behavior!!
2022-01-20 23:48:33 -05:00
Brandon Thomas
6950a86821
better, but gets stuck / blocking
2022-01-20 22:07:52 -05:00
Brandon Thomas
7e875f6b37
much cleaner thread, but redis lease doesn't get renewed
2022-01-20 22:03:06 -05:00
Brandon Thomas
ebda0d9317
threads as structs
2022-01-20 21:24:31 -05:00
Brandon Thomas
5647cacfa9
wip
2022-01-19 23:51:57 -05:00
Brandon Thomas
1ec18e5daa
cleanup
2022-01-18 23:11:22 -05:00
Brandon Thomas
7bc698482c
more cleanup
2022-01-18 23:02:04 -05:00
Brandon Thomas
035acf62c5
less type juggling
2022-01-18 22:57:55 -05:00
Brandon Thomas
0cb8cbd802
store lowercase twitch username
2022-01-18 22:42:05 -05:00
Brandon Thomas
ab90af892f
misc
2022-01-18 21:47:00 -05:00
Brandon Thomas
d83fbb993e
got cheer !!!
2022-01-18 00:22:57 -05:00
Brandon Thomas
52785debf7
more pubsub
2022-01-17 23:58:06 -05:00
Brandon Thomas
46b688aa28
more
2022-01-17 23:30:00 -05:00
Brandon Thomas
7a9f747d7d
leasing (WIP)
2022-01-17 21:15:05 -05:00
Brandon Thomas
5f66017fb7
more work towards threading, redis messaging
2022-01-17 15:20:05 -05:00
Brandon Thomas
ffe86adc60
this threading paradigm should work!
2022-01-16 19:18:41 -05:00
Brandon Thomas
446dd31f81
redis pubsub works!
2022-01-16 18:59:55 -05:00
Brandon Thomas
698c052036
background thread (won't ctrl-c)
2022-01-16 18:42:36 -05:00
Brandon Thomas
76ef8be03f
cleanup
2022-01-16 18:31:23 -05:00
Brandon Thomas
4af8aeee5b
publish session active events
2022-01-16 18:20:51 -05:00
Brandon Thomas
e489d7f245
json test
2022-01-16 17:19:25 -05:00
Brandon Thomas
713fc6bd1c
make redis_common lib crate to contain centralized Redis keys, etc.
2022-01-16 17:07:09 -05:00
Brandon Thomas
c0e9fe7d0e
update dockerfile
2022-01-16 11:09:12 -05:00
Brandon Thomas
85f27e603f
Move migrations directories to sort first, needs PATCHED diesel-cli
2022-01-16 11:07:59 -05:00
Brandon Thomas
c0833bb69a
Docs on Redis schema
2022-01-16 10:42:17 -05:00
Brandon Thomas
277cb36c85
cleanup websocket
2022-01-16 10:14:31 -05:00
Brandon Thomas
37331f685a
fix twitch query, add common error library code
2022-01-16 10:06:30 -05:00
Brandon Thomas
8f8a3e44f3
Two Redis indices. Twitch/OBS will be on n=1
...
This will require updating deployment yamls.
2022-01-15 14:22:37 -05:00
Brandon Thomas
1343ab2de1
move docs to top
2022-01-15 11:40:58 -05:00
Brandon Thomas
c4f42cb4f9
update to make username mandatory field
2022-01-15 11:38:40 -05:00
Brandon Thomas
c8bfb1f2f0
codegen db
2022-01-12 01:42:53 -05:00
Brandon Thomas
0a27c79ee3
handle more fields
2022-01-12 01:36:42 -05:00
Brandon Thomas
322d957105
persist twitch tokens to db! woo!
2022-01-12 01:27:47 -05:00
Brandon Thomas
38d58cf0c7
WIP: sqlx / actix version mismatch
2022-01-12 00:59:28 -05:00
Brandon Thomas
fdaa4a2eef
fix queries
2022-01-12 00:17:08 -05:00
Brandon Thomas
405834f2d6
"find" builder (not yet working)
2022-01-12 00:05:26 -05:00
Brandon Thomas
ee5d4be0a6
add ip address at creation
2022-01-11 22:23:53 -05:00
Brandon Thomas
86953af7c2
new shared lib crate for db queries, insert into oauth tokens
2022-01-11 22:18:40 -05:00
Brandon Thomas
367595f4e8
work on twitch database table schema
2022-01-11 21:14:51 -05:00
Brandon Thomas
902ae9e5be
Split up documentation across multiple files
2022-01-11 20:17:17 -05:00
Brandon Thomas
c3e3bf8ef8
this appears to work
2022-01-11 00:43:07 -05:00
Brandon Thomas
95486d659a
new design idea: separate job to handle polling
2022-01-11 00:42:00 -05:00
Brandon Thomas
f05eb2589a
ugh, this is not working
2022-01-10 20:21:00 -05:00
Brandon Thomas
20c5a9578a
this compiles! does it work?
2022-01-10 19:06:16 -05:00
Brandon Thomas
40fdb3d2ac
WIP (not building)
2022-01-10 18:58:46 -05:00
Brandon Thomas
5907ba7aa6
async blocks
2022-01-10 05:05:50 -05:00
Brandon Thomas
fd9cfc159b
refactor
2022-01-10 04:39:02 -05:00
Brandon Thomas
22cf399f5c
more refactor
2022-01-10 04:24:04 -05:00
Brandon Thomas
7aa33d19b0
refactor
2022-01-10 03:33:23 -05:00
Brandon Thomas
d29286a164
simplify - polling client is too much
2022-01-10 03:19:30 -05:00
Brandon Thomas
f7bf44f64c
proved we can have multiple threads now
...
Old setup was blocking, must have executed on the same runtime thread
Need a way to prevent people from spinning up multiple threads.
2022-01-10 02:37:25 -05:00
Brandon Thomas
d77f723c98
move a few more utilities to common code (tokens, uuids)
2022-01-10 02:33:51 -05:00
Brandon Thomas
a6855f5b80
start using container shared lib
2022-01-10 02:12:38 -05:00
Brandon Thomas
380b5d62a3
sort shared library directory tree before app code
2022-01-10 01:52:44 -05:00
Brandon Thomas
8500c2d888
this seems to work ?
2022-01-09 21:32:03 -05:00
Brandon Thomas
6b03fb84c5
OBS WIP
2022-01-09 21:14:15 -05:00
Brandon Thomas
cb5a135f68
trying to figure out websocket stuff again
2022-01-09 02:57:20 -05:00
Brandon Thomas
e9fd96cd4b
OBS
2022-01-09 01:32:26 -05:00
Brandon Thomas
aad92d7295
CORS for storyteller.io
2022-01-08 02:43:32 -05:00
Brandon Thomas
00036b0b5d
proper setup for local dev + optional ssl
2022-01-07 16:56:49 -05:00
Brandon Thomas
eb028fe561
Filter out deleted category assignments
2022-01-07 02:59:29 -05:00
Brandon Thomas
dc1fc75c2d
simplify readme
2022-01-07 02:37:25 -05:00
Brandon Thomas
df7283a407
storyteller ssl nginx configs + plain http
2022-01-07 02:35:37 -05:00
Brandon Thomas
1f41401660
add SSL version of nginx configs
2022-01-07 02:30:29 -05:00
Brandon Thomas
b691750df4
docs
2022-01-07 01:57:45 -05:00
Brandon Thomas
20676f595a
only need one nginx file
2022-01-07 01:53:47 -05:00
Brandon Thomas
ac95040be2
Add nginx config files (from mac)
2022-01-06 19:13:28 -05:00
Brandon Thomas
5c3afb0e68
note about migrations in prod
2022-01-06 03:09:07 -05:00
Brandon Thomas
14159a26a6
also sort the tts models
2022-01-05 02:08:00 -05:00
Brandon Thomas
963c5f7c32
natural+lexographic sort of category dropdown names
2022-01-05 02:04:55 -05:00
Brandon Thomas
62d894b826
Add deleted_at and other timestamps so it resembles other endpoints
...
It's not too bloated (# categories is tractable), and we need these for
endpoint uniformity
2022-01-03 05:54:47 -05:00
Brandon Thomas
85a21efaf6
Fix sqlx issue preventing builds
...
Move to Rust workspace broke how OFFLINE mode db schema/query cache is
read and stored.
2022-01-03 02:27:24 -05:00
Brandon Thomas
684603eebd
Fix OBS builds
2022-01-03 01:56:52 -05:00
Brandon Thomas
ad722ed505
show/hide categories with tri-state query params
2022-01-02 01:00:42 -05:00
Brandon Thomas
d2f6fb5c3d
make "delete category" a mod handler
2022-01-01 23:47:12 -05:00
Brandon Thomas
a050c4d2de
additional filtering on models
2021-12-31 06:25:26 -05:00
Brandon Thomas
7a83a51ca3
Fix bug with removing categories
2021-12-31 05:21:53 -05:00
Brandon Thomas
f97cdc1ae5
tree integrity checks
2021-12-31 05:11:07 -05:00
Brandon Thomas
60cb078cd3
comment
2021-12-31 03:55:53 -05:00
Brandon Thomas
c15f694a1d
forgot a GET endpoint for single categories
2021-12-31 02:48:42 -05:00
Brandon Thomas
9f508aedbe
Category assignment flag check
2021-12-31 02:05:33 -05:00
Brandon Thomas
db7f5d20fe
additional create category bool
2021-12-30 19:37:50 -05:00
Brandon Thomas
4777ca25fa
Move edit category to moderation, add list handler
2021-12-30 02:49:42 -05:00
Brandon Thomas
8138766583
Endpoint to list categories for model (not working?)
2021-12-30 02:22:26 -05:00
Brandon Thomas
adc365cf44
list assigned category query builder
2021-12-30 01:39:36 -05:00
Brandon Thomas
654f826598
add tts categories to model list results
2021-12-29 02:50:50 -05:00
Brandon Thomas
e78e1079e3
test category assignments
2021-12-29 01:12:03 -05:00
Brandon Thomas
10726dde2b
HTTP endpoint to assign / remove categories (untested)
2021-12-29 00:13:38 -05:00
Brandon Thomas
2f74df29ff
shorter tokens, fix test
2021-12-28 22:53:13 -05:00
Brandon Thomas
556fa360d3
add list tts category handler
2021-12-28 03:14:37 -05:00
Brandon Thomas
d3435a1f4b
fix tests on list categories, split filtering of deleted/unapproved
2021-12-28 02:09:19 -05:00
Brandon Thomas
48394fe5f8
modify category schema; create category list query builder
2021-12-27 04:25:40 -05:00
Brandon Thomas
732c90f1e6
edit category endpoint
2021-12-22 05:10:29 -05:00
Brandon Thomas
c34de2b8d7
Minor cleanup
2021-12-22 04:42:27 -05:00
Brandon Thomas
d23859fb75
better rustfmt rules? still not ready to apply these
2021-12-22 03:36:26 -05:00
Brandon Thomas
1e0847ecdd
hypothetical rustfmt rules (not yet applied to codebase)
2021-12-22 03:16:53 -05:00
Brandon Thomas
eb11bb5118
Delete and undelete categories
2021-12-22 01:02:11 -05:00
Brandon Thomas
9668a3274e
Add new params for mods in create category
2021-12-22 00:30:37 -05:00
Brandon Thomas
42637b2949
Fix create category and test endpoint, add idempotency
2021-12-22 00:12:58 -05:00
Brandon Thomas
9f0763b5ea
Run cargo fix to fix imports
2021-12-21 23:48:17 -05:00
Brandon Thomas
7088b8657d
category create route
2021-12-21 23:39:37 -05:00
Brandon Thomas
2119cfbe09
add an ip banlist error message
2021-12-21 23:08:10 -05:00
Brandon Thomas
591f3ac2ad
organize routes module
2021-12-21 22:52:00 -05:00
Brandon Thomas
5db08c3b83
Move routes to their own file for maintainability
2021-12-21 12:27:51 -05:00
Brandon Thomas
18c3913f8f
create category endpoint (no route)
2021-12-21 01:55:32 -05:00
Brandon Thomas
bbc268aaef
Empty rust modules, change schema to add w2l support
2021-12-20 22:45:14 -05:00
Brandon Thomas
4cb208bad7
Model category tables
2021-12-20 19:37:21 -05:00
Brandon Thomas
69dad0d854
move unused OBS migrations out of the way (for now)
2021-12-20 17:56:17 -05:00
Brandon Thomas
898fe142e9
Uncommitted old OBS code
2021-12-20 17:47:16 -05:00
Brandon Thomas
90950567e2
cors for fakeyou.com
2021-11-18 01:37:30 -05:00
Brandon Thomas
20e0f265c1
read more topics
2021-11-17 01:14:40 -05:00
Brandon Thomas
80db649b9f
wip
2021-11-17 01:03:12 -05:00
Brandon Thomas
2514ec3356
wip websocket + twitch pubsub (not working)
2021-11-17 00:36:05 -05:00
Brandon Thomas
885ad53383
websockets basics work, cors fix
2021-11-16 22:56:29 -05:00
Brandon Thomas
39906ae9c2
begin testing websockets
2021-11-16 22:51:06 -05:00
Brandon Thomas
fe7b8a8d07
now with refresh token
2021-11-16 20:41:29 -05:00
Brandon Thomas
dd8945dc5e
Oauth redemption works, but I'm hacking the CSRF
2021-11-16 20:36:22 -05:00
Brandon Thomas
d370d13f2d
OAuth flow compiles, but has issues
2021-11-16 20:00:16 -05:00
Brandon Thomas
6bf35a8381
oauth enrollment wip
2021-11-16 06:28:57 -05:00
Brandon Thomas
75aa1f81aa
redirect oauth endpoint
2021-11-15 02:36:05 -05:00
Brandon Thomas
9b2c0edcc5
Twitch oauth enroll endpoint
2021-11-15 02:28:25 -05:00
Brandon Thomas
c7989106b7
Attempt to fix dockerfile
2021-11-15 00:33:57 -05:00
Brandon Thomas
807365bd61
fixup loc.sh
2021-11-15 00:32:24 -05:00
Brandon Thomas
7e5f2b8c10
cleanup bucket client
2021-11-15 00:30:37 -05:00
Brandon Thomas
1e19067113
Repair model/ files that were overwritten for testing
2021-11-15 00:13:25 -05:00
Brandon Thomas
65934b2041
IP polling job works now. Migrated to Tokio runner
2021-11-13 00:46:34 -05:00
Brandon Thomas
6cb6c83dba
clean up dependencies
2021-11-12 23:58:10 -05:00
Brandon Thomas
a3bbf7b42c
Refactor crate organization. Both server binaries build
2021-11-12 23:51:25 -05:00
Brandon Thomas
23f5051ace
cleanup
2021-11-12 23:43:33 -05:00
Brandon Thomas
5ce4bd3b37
Cleanup IP filter
2021-11-12 23:35:43 -05:00
Brandon Thomas
4aa9724d41
BROKEN, BUT - filter works !! Needs cleanup and correct logic
2021-11-12 20:05:54 -05:00
Brandon Thomas
6849e6d051
HOLY SHIT, MIDDLEWARE ORDER MATTERED
...
https://issueexplorer.com/issue/actix/actix-extras/191
2021-11-12 19:52:00 -05:00
Brandon Thomas
38cc8f31a8
NOT WORKING (but close?)
2021-11-12 19:46:57 -05:00
Brandon Thomas
5c9da5fae5
Middleware not compiling, see:
...
https://stackoverflow.com/questions/68944823/returning-an-unauthorized-response-in-actix-web-middleware-in-rust
2021-11-12 18:12:13 -05:00
Brandon Thomas
f2f39685a9
WIP filter (not working)
2021-11-12 04:36:50 -05:00
Brandon Thomas
2b3fdb87e0
BROKEN: IP filter compiles, but does not block
2021-11-12 03:30:15 -05:00
Brandon Thomas
30c26647da
rust-s3 "never-encode-slash" feature seems to do the trick!
2021-11-12 03:01:37 -05:00
Brandon Thomas
a26e11a294
BROKEN: OBS gateway now runs on same actix and shared code
2021-11-12 01:14:29 -05:00
Brandon Thomas
c40d772ebc
MAYBE BROKEN: Full actix/tokio/etc. upgrade on storyteller-web
2021-11-12 01:12:39 -05:00
Brandon Thomas
e424297abf
WIP
2021-11-12 00:07:17 -05:00
Brandon Thomas
aa7c13ad5d
BROKEN - rearrange workspace to group libraries
2021-11-11 22:20:39 -05:00
Brandon Thomas
c55cc81022
TEMP BROKEN - need to upgrade storyteller-web, I think
...
The situation with selectively enabling different versions off actix
in a workspace using library features is crazy. It doesn't work,
anyway.
2021-11-11 22:13:53 -05:00
Brandon Thomas
aa38f0a71f
mostly working for two projects (broke 404 handler, index)
2021-11-09 23:12:04 -05:00
Brandon Thomas
d0c156718a
fix for obs-gateway (broken for a few commits now)
2021-11-09 23:00:39 -05:00
Brandon Thomas
6c9fc98c68
update docs
2021-11-09 22:18:47 -05:00
Brandon Thomas
d209e7fd79
HACK: Multiple versions of actix in support package with features
2021-11-09 22:16:18 -05:00
Brandon Thomas
8a00f37e9e
wip using common HTTP utils
2021-11-09 21:13:44 -05:00
Brandon Thomas
7256630d87
http common package versions that work with both apps
2021-11-08 05:02:42 -05:00
Brandon Thomas
5507e3bd6a
setup for new oauth endpoints (disabled temporarily)
2021-11-08 04:48:36 -05:00
Brandon Thomas
5ba21a9771
more of the oauth flow, fixing tokio versions
2021-11-08 01:52:38 -05:00
Brandon Thomas
06a327367c
versions of tokio/actix work for OBS gateway
2021-11-08 00:57:02 -05:00
Brandon Thomas
a727e261d1
Figuring out Tokyo runtimes between projects (ugh...)
2021-11-08 00:19:56 -05:00
Brandon Thomas
5809dd7c40
Share CORS configs
2021-11-07 23:39:54 -05:00
Brandon Thomas
60e0ef5860
Twitch secrets handling, AnyhowResult in common crate, etc.
2021-11-07 23:32:21 -05:00
Brandon Thomas
9b2d2957ca
websocket examples
2021-11-07 19:49:35 -05:00
Brandon Thomas
1fed826127
line count statistics fix
2021-11-07 15:39:24 -05:00
Brandon Thomas
18ce4e1c62
Move websocket endpoint to OBS app
2021-11-07 15:36:14 -05:00
Brandon Thomas
f049a6f7d0
Make a shared "http server common" package
2021-11-07 15:24:28 -05:00
Brandon Thomas
0c409c6af1
Shared config package
2021-11-07 15:03:42 -05:00
Brandon Thomas
f166837083
Fix up dockerfile for image builds
2021-11-07 14:37:13 -05:00
Brandon Thomas
5dd7efa2d5
Massive refactor: Two app packages in a workspace (5 binaries total)
2021-11-07 14:35:34 -05:00
Brandon Thomas
e05d519e5a
NEW OBS GATEWAY ARC (NOT YET WOKRING)
2021-11-07 14:07:01 -05:00
Brandon Thomas
de80284665
util to get http hostname header (turns out I don't need it yet)
2021-09-28 01:09:14 -04:00
Brandon Thomas
5187d25e91
add fakeyou.com to CORS
2021-09-27 17:47:47 -04:00
Brandon Thomas
12543a1fdd
oauth flow works, ugh
2021-09-27 00:32:30 -04:00
Brandon Thomas
6db56b89a4
no progress
2021-09-26 23:49:38 -04:00
Brandon Thomas
63c960a7aa
user id lookup with helix
2021-09-26 23:20:34 -04:00
Brandon Thomas
0018e51eb5
attempt access tokens and scopes (failing)
2021-09-26 21:12:38 -04:00
Brandon Thomas
c2eb31cbb2
listen wip
2021-09-26 20:33:51 -04:00
Brandon Thomas
fc19a1430b
listen command
2021-09-26 20:29:57 -04:00
Brandon Thomas
94ea57deac
close method
2021-09-26 20:11:04 -04:00
Brandon Thomas
b6ec22e343
this doesn't behave as I'd expect.
2021-09-26 20:07:02 -04:00
Brandon Thomas
00fef2a2d2
more structure, but still too rigid
2021-09-26 18:16:22 -04:00
Brandon Thomas
33867a5485
refactor
2021-09-26 17:49:22 -04:00
Brandon Thomas
90b43bf762
send ping
2021-09-26 12:26:12 -04:00
Brandon Thomas
f67d048f27
connects to websockets (wrong library feature enabled)
2021-09-26 04:04:07 -04:00
Brandon Thomas
e95ff9a7fa
try to connect over websockets (400)
2021-09-26 03:08:34 -04:00
Brandon Thomas
a0d9bdb0d5
read secrets file
2021-09-26 02:32:16 -04:00
Brandon Thomas
5e270d5c69
client successfully calls twitch with helix+secrets, not oauth flow
2021-09-26 02:23:37 -04:00
Brandon Thomas
1ccf1e90da
Adding a Twitch client wrapper, secrets store
2021-09-25 16:50:34 -04:00
Brandon Thomas
82120fff8e
First commit / hello world
2021-09-24 23:18:01 -04:00
Brandon Thomas
383a5a99ff
tts model cache duration configurable
2021-09-20 01:25:44 -04:00
Brandon Thomas
ef8711ab2e
codegen
2021-09-20 00:48:36 -04:00
Brandon Thomas
8ec7f0956b
TTL cache list of models in memory to de-strain the DB
2021-09-20 00:47:10 -04:00
Brandon Thomas
535f957467
codegen
2021-09-19 20:20:51 -04:00
Brandon Thomas
b9e4087e3e
mark jobs permanently dead if models are gone
2021-09-19 20:20:06 -04:00
Brandon Thomas
40b35fb642
warn to error level log
2021-09-19 19:33:57 -04:00
Brandon Thomas
e3fd377257
codegen db for new endpoint
2021-09-17 02:58:32 -04:00
Brandon Thomas
fb320f0338
endpoint to count voices
2021-09-17 02:50:14 -04:00
Brandon Thomas
d29990b877
rename endpoint directory
2021-09-17 02:06:53 -04:00
Brandon Thomas
d615a05930
Update README.md
2021-09-14 23:57:46 -04:00
Brandon Thomas
ef4a25ee6e
freaking dockerfile
2021-09-13 06:03:40 -04:00
Brandon Thomas
58af7c52c8
don't spam newrelic
2021-09-13 05:46:18 -04:00
Brandon Thomas
7bcb9090ae
Add NewRelic tracing to tts-inference-job using vendored lib
2021-09-13 05:44:47 -04:00
Brandon Thomas
bb10e6fc89
add temp file deletion for a few w2l inference error cases too
2021-09-12 17:42:47 -04:00
Brandon Thomas
f26a3318c4
put in deletion of intermediate files (but not on error)
2021-09-12 17:39:56 -04:00
Brandon Thomas
cf57772a39
delete intermediate results in tts inference
2021-09-12 17:37:17 -04:00
Brandon Thomas
c934e6eeb4
delete intermediate results in w2l download job
2021-09-12 17:32:39 -04:00
Brandon Thomas
aca73c32e3
make shared functions
2021-09-12 17:21:47 -04:00
Brandon Thomas
0450adb396
attempt to delete files after they're uploaded
2021-09-12 17:07:41 -04:00
Brandon Thomas
0d691ded80
fix tts download job from breaking
2021-09-12 16:45:22 -04:00
Brandon Thomas
5c8731eba9
silent k slur also works. ugh :(
2021-09-12 12:24:20 -04:00
Brandon Thomas
aabf5579e1
fix pending queue bug when queue empty
2021-09-12 02:11:49 -04:00
Brandon Thomas
5ac58bd849
codegen db
2021-09-12 01:13:34 -04:00
Brandon Thomas
ab974cecb2
add new pending w2l templates endpoint
2021-09-12 01:12:56 -04:00
Brandon Thomas
a7d986d3f0
codegen
2021-09-12 00:38:19 -04:00
Brandon Thomas
c6018b4ebd
add seconds of waiting to job status
2021-09-12 00:37:47 -04:00
Brandon Thomas
3e9ff8ff7c
fix failing test
2021-09-11 04:44:34 -04:00
Brandon Thomas
d359427e42
fix rate limiter package
2021-09-11 04:43:17 -04:00
Brandon Thomas
591d828da3
more rate limiting for important endpoints
2021-09-11 04:27:40 -04:00
Brandon Thomas
4d928bd8de
Rate limiter for TTS
2021-09-11 04:19:06 -04:00
Brandon Thomas
71dc65a5e4
codegen db
2021-09-11 02:49:38 -04:00
Brandon Thomas
3697c353cc
stats for both queues
2021-09-11 02:48:04 -04:00
Brandon Thomas
00131daedf
talknet downloads wip (BROKEN)
2021-09-10 05:16:58 -04:00
Brandon Thomas
620de4c528
Update tts_models schema to track TalkNet-related details
2021-09-10 04:21:47 -04:00
Brandon Thomas
e3233f4c32
add talknet as a model type
2021-09-10 02:35:52 -04:00
Brandon Thomas
c529756ab7
rename migration directory
2021-09-10 01:33:58 -04:00
Brandon Thomas
743f2bf560
Create "squashed" schema references with central documentation
2021-09-10 01:27:04 -04:00
Brandon Thomas
567a572487
Merge branch 'master' of github.com:storytold/storyteller-web
2021-09-09 23:59:06 -04:00
Brandon Thomas
def7e4f3cf
Update README.md
2021-09-09 23:58:40 -04:00
Brandon Thomas
da16826ab5
talknet works
2021-09-09 03:01:06 -04:00
Brandon Thomas
a681778046
end-to-end working? need to test the audio
2021-09-09 02:57:12 -04:00
Brandon Thomas
6db5f0187b
model loading, arpabet
2021-09-09 02:38:38 -04:00
Brandon Thomas
694789cef8
notes + requirements
2021-09-08 22:41:09 -04:00
Brandon Thomas
27c05a6207
create WIP talknet server
2021-09-08 22:35:58 -04:00
Brandon Thomas
9f71d4ec33
Update README.md
2021-09-07 23:56:59 -04:00
Brandon Thomas
1ad7d5bc7e
codegen
2021-09-06 08:52:53 -04:00
Brandon Thomas
412830e922
exclude deleted from leaderboard
2021-09-06 08:52:13 -04:00
Brandon Thomas
ef5140e2f3
re-codegen for leaderboard
2021-09-06 07:48:58 -04:00
Brandon Thomas
922e5d5c99
add tts leaderboard
2021-09-06 07:48:23 -04:00
Brandon Thomas
b59d19a7c8
add w2l results to leaderboard (wip)
2021-09-06 07:43:02 -04:00
Brandon Thomas
eeef9cc916
fixup IP address handling
2021-09-06 06:56:36 -04:00
Brandon Thomas
24d6d86142
try to fix up IP handling
2021-09-06 06:09:54 -04:00
Brandon Thomas
fffcdd8514
hide tts results from banned users (and codegen db)
2021-09-06 05:12:15 -04:00
Brandon Thomas
81fa3448e6
tts view hidden for banned users
2021-09-06 04:42:24 -04:00
Brandon Thomas
cd85c61d0d
add IP addresses, but probably not ideal to show in frontend list
2021-09-06 04:01:59 -04:00
Brandon Thomas
d72958b749
list users endpoint
2021-09-06 01:43:28 -04:00
Brandon Thomas
ec42723cf0
move query builders together
2021-09-05 22:22:24 -04:00
Brandon Thomas
451f394807
rename query builder
2021-09-05 22:17:15 -04:00
Brandon Thomas
562d37ee7a
WIP query builder for moderator user list
2021-09-05 22:14:05 -04:00
Brandon Thomas
9711ce72b9
fix minor result error
2021-09-03 06:32:10 -04:00
Brandon Thomas
1ce4f66b1c
codegen'd db
2021-09-03 06:09:46 -04:00
Brandon Thomas
a794397369
hide w2l results made by banned inference users or template creators
2021-09-03 06:08:44 -04:00
Brandon Thomas
eb75000c80
codegen db
2021-09-03 05:46:29 -04:00
Brandon Thomas
f70bc0ca2e
don't show w2l templates for banned users
2021-09-03 05:26:39 -04:00
Brandon Thomas
e59fdb2251
don't report session status for banned
2021-09-03 05:17:13 -04:00
Brandon Thomas
5bafb0503f
disallow editing profile for banned users
2021-09-03 05:09:33 -04:00
Brandon Thomas
ecbc76d3b7
deny logins to banned users
2021-09-03 05:00:48 -04:00
Brandon Thomas
10d50fc684
hide banned users
2021-09-03 04:54:47 -04:00
Brandon Thomas
b88966478b
new "enable" endpoint to make opt-in easier
2021-09-03 03:29:39 -04:00
Brandon Thomas
c123d499ba
fix newlines issue
2021-09-03 02:41:42 -04:00
Brandon Thomas
d1281a1f6c
Rename audio files to include vocodes_
2021-09-03 02:16:34 -04:00
Brandon Thomas
15a46805f7
update codegen queries
2021-09-02 04:50:06 -04:00
Brandon Thomas
2daee0ff83
move moderator fields to sub-message
2021-09-02 04:19:00 -04:00
Brandon Thomas
2a9e1a7eed
refactor ban endpoint
2021-09-02 04:03:08 -04:00
Brandon Thomas
163fcabd73
light refactor
2021-09-02 03:54:57 -04:00
Brandon Thomas
2cedbb6ed9
allow usernames with dashes and underscores
2021-09-02 02:54:22 -04:00
Brandon Thomas
e9662fef67
Add two WIP user ban endpoints
2021-09-02 02:45:36 -04:00
Brandon Thomas
e6f8eb3b35
error messages for login
2021-09-01 04:40:17 -04:00
Brandon Thomas
75bfbe0753
check reserved usernames with dashes
2021-09-01 03:36:37 -04:00
Brandon Thomas
0b908906c0
more words to decline
2021-09-01 03:29:55 -04:00
Brandon Thomas
dbd979f126
create account with better error responses
2021-09-01 02:51:52 -04:00
Brandon Thomas
d336ff7985
Update README.md
2021-08-31 23:58:19 -04:00
Brandon Thomas
6239b2b765
re-codegen
2021-08-30 06:04:39 -04:00
Brandon Thomas
d5646ebbdb
add gravatar to model list
2021-08-30 06:04:01 -04:00
Brandon Thomas
7877a5505b
re-codegen
2021-08-30 04:58:14 -04:00
Brandon Thomas
a6bc7908c2
gravar hashes for w2l templates
2021-08-30 04:57:40 -04:00
Brandon Thomas
d38322a868
Add TTS creator's gravatar hash
2021-08-30 04:40:28 -04:00
Brandon Thomas
2c8d512997
adjust relative imports
2021-08-29 05:05:47 -04:00
Brandon Thomas
584aedc905
clarifiying comment on requirements
2021-08-29 04:30:20 -04:00
Brandon Thomas
df36f9c246
closer to import working...
2021-08-29 04:28:53 -04:00
Brandon Thomas
6dfb8eca48
requirements for talknet (wip)
2021-08-29 04:24:35 -04:00
Brandon Thomas
340267b394
move talknet, etc. for reuse
2021-08-29 04:17:59 -04:00
Brandon Thomas
bcc31bcc04
adjust dockerfile and .env for new model location
2021-08-29 03:54:02 -04:00
Brandon Thomas
1a15029a22
reorganize tts models so pieces can be shared (BROKEN!)
2021-08-29 03:21:40 -04:00
Brandon Thomas
d70142219a
Move TalkNet out of tacotron2
2021-08-29 02:22:43 -04:00
Brandon Thomas
01a96f4141
Move NeMo/nemo out so it can be imported
2021-08-28 23:38:51 -04:00
Brandon Thomas
3839ae0dfc
Add __init__ files for module imports
2021-08-28 23:28:06 -04:00
Brandon Thomas
5c1d1a1bce
remove irrelevant requirements files
2021-08-28 23:18:47 -04:00
Brandon Thomas
fb877bc290
ControllableTalkNet from https://github.com/SortAnon/ControllableTalkNet
2021-08-28 23:15:29 -04:00
Brandon Thomas
f9871d9d05
Add NeMo from https://github.com/SortAnon/NeMo
2021-08-28 23:00:32 -04:00
Brandon Thomas
b897245a09
re-codegen db
2021-08-28 04:36:39 -04:00
Brandon Thomas
5cc2ee3bda
report status of tts downloads
2021-08-28 04:06:38 -04:00
Brandon Thomas
cca6d9cdfc
Return empty maybe_extra_status from TTS upload (WIP)
2021-08-28 02:38:24 -04:00
Brandon Thomas
1fa3b9b880
When the w2l job fails, fail permanently
2021-08-28 02:35:00 -04:00
Brandon Thomas
0fef8a6838
report on w2l template download status
2021-08-28 01:33:54 -04:00
Brandon Thomas
f0aeb42d06
reuse as RedisJobStatusLogger
2021-08-27 23:30:31 -04:00
Brandon Thomas
a8886db089
move redis key util (making more)
2021-08-27 22:54:22 -04:00
Brandon Thomas
09038a4b34
update to use youtube-dl fork
2021-08-27 22:47:11 -04:00
Brandon Thomas
33c5087544
job debugging
2021-08-27 02:40:16 -04:00
Brandon Thomas
eca2b62d24
Merge branch 'master' of github.com:storytold/storyteller-web
2021-08-27 02:23:27 -04:00
Brandon Thomas
71b35183f9
improve safety of redis logging for tts
2021-08-27 02:16:33 -04:00
Brandon Thomas
75a938e0b3
in-progress extra status data for w2l inference
2021-08-27 02:05:40 -04:00
Brandon Thomas
2cbc86ddce
report detailed TTS inference status
2021-08-27 01:22:27 -04:00
Brandon Thomas
1c524ed78b
query redis status in tts inference endpoint
2021-08-27 00:47:39 -04:00
Brandon Thomas
3702332669
new redis keys
2021-08-26 23:59:51 -04:00
Brandon Thomas
fb24e58d56
Update README.md
2021-08-26 00:00:15 -04:00
Brandon Thomas
c396a91881
Massive update + schema change. Add vocoder flexibility
2021-08-25 04:00:57 -04:00
Brandon Thomas
90e1db42c4
Sidecar supports both vocoders and uses the one in the HTTP request
2021-08-25 02:21:59 -04:00
Brandon Thomas
f4c8bb0095
plumbing for vocoders (mostly done)
2021-08-25 01:59:30 -04:00
Brandon Thomas
6ddc641475
intermediate plumbing for new vocoders (3)
2021-08-25 01:39:29 -04:00
Brandon Thomas
a61e144ecb
intermediate plumbing for new vocoders (2)
2021-08-25 01:32:37 -04:00
Brandon Thomas
21cffc1f03
intermediate plumbing for new vocoders
2021-08-25 01:11:36 -04:00
Brandon Thomas
c9112b7714
remove unused model code
2021-08-25 00:33:24 -04:00
Brandon Thomas
79ee6e408a
I think this works and sounds good!!
2021-08-22 21:28:18 -04:00
Brandon Thomas
d7c6e0d68d
almost working, but sounds super distorted
2021-08-22 21:26:11 -04:00
Brandon Thomas
3d61120ecb
this appears to work end-to-end, but I need to output the sound
2021-08-22 21:15:19 -04:00
Brandon Thomas
c52ce4de0a
WIP pipeline with hifigan
2021-08-22 21:08:01 -04:00
Brandon Thomas
a821afaebe
I can now load hifigan models from TT
2021-08-22 20:27:02 -04:00
Brandon Thomas
76fd658ae6
move hifigan to make import disambiguation easier
2021-08-22 20:07:43 -04:00
Brandon Thomas
e4fe7f8ed1
don't print devices
2021-08-22 19:42:07 -04:00
Brandon Thomas
6516a04eda
print devices
2021-08-22 19:41:50 -04:00
Brandon Thomas
d0ee1962d8
Move hifi-gan under tacotron2
2021-08-22 19:16:33 -04:00
Brandon Thomas
1a7fc2ab72
Add HifiGan model ( https://github.com/SortAnon/hifi-gan.git )
2021-08-20 01:13:51 -04:00
Brandon Thomas
d1e5cd9923
codegen db
2021-08-18 23:28:03 -04:00
Brandon Thomas
c071bcfe1e
return description for w2l templates
2021-08-18 23:27:26 -04:00
Brandon Thomas
7719262904
codegen sql
2021-08-17 03:52:44 -04:00
Brandon Thomas
fd0dcb95a4
new endpoint to edit w2l result visibility (untested)
2021-08-17 03:52:01 -04:00
Brandon Thomas
b3ee7bb1f7
Update result visibility (new endpoint)
2021-08-17 03:00:55 -04:00
Brandon Thomas
2522bfca91
update creator set visibility in models/templates (untested)
2021-08-17 00:58:23 -04:00
Brandon Thomas
5f71e30e2d
re-codegen
2021-08-16 22:59:56 -04:00
Brandon Thomas
94cfaba606
Add creator_set_visibility to TTS model and W2L template
2021-08-16 22:59:14 -04:00
Brandon Thomas
20668c267b
show visibility for W2L results
2021-08-15 22:39:20 -04:00
Brandon Thomas
cf28558c27
return privacy on tts results
2021-08-15 22:26:32 -04:00
Brandon Thomas
a2f2763759
Visibility in endpoints: don't list hidden results
2021-08-11 20:28:57 -04:00
Brandon Thomas
7738d45be0
use no-op logger in other 3 jobs (already in TTS inference)
2021-08-11 19:52:50 -04:00
Brandon Thomas
ce21551109
fix types
2021-08-11 19:26:28 -04:00
Brandon Thomas
3967e1236c
fix codegen
2021-08-11 17:45:16 -04:00
Brandon Thomas
e4aa009750
result visibility editing fix
2021-08-11 17:44:15 -04:00
Brandon Thomas
bf10676680
re-codegen
2021-08-07 18:51:57 -04:00
Brandon Thomas
92949a719b
fix visibility db serialization bug
2021-08-07 18:51:09 -04:00
Brandon Thomas
cd41803b7c
re-codegen (need to update FE to respect profile edit)
2021-07-11 19:20:07 -04:00
Brandon Thomas
cde4f33489
added to w2l
2021-07-11 19:19:37 -04:00
Brandon Thomas
cc959f88fd
hack record visibility
2021-07-11 19:14:26 -04:00
Brandon Thomas
6bcd1033a1
jobs: creator visibility propagation
2021-07-11 17:12:35 -04:00
Brandon Thomas
04ea0d7d8c
more propagation of visibility
2021-07-11 16:49:03 -04:00
Brandon Thomas
444511d79e
propagate visibility to enqueue tts infer
2021-07-11 16:38:26 -04:00
Brandon Thomas
baffa751d6
visibility enums
2021-07-11 16:19:33 -04:00
Brandon Thomas
bdf549cc1d
enums work (not yet finished)
2021-07-11 16:15:07 -04:00
Brandon Thomas
e7c0c5b6f0
codegen
2021-07-10 22:17:52 -04:00
Brandon Thomas
a875e138eb
model deletion improvement for tts results
2021-07-10 22:17:00 -04:00
Brandon Thomas
5586abe7a2
better delete for w2l results
2021-07-10 21:38:47 -04:00
Brandon Thomas
0e3059f906
better deletion for w2l templates
2021-07-10 21:12:19 -04:00
Brandon Thomas
c306730c0b
use common delete permission check
2021-07-10 13:30:31 -04:00
Brandon Thomas
2c342ac1d9
fixup tests
2021-07-10 13:25:28 -04:00
Brandon Thomas
b0e09cf9c5
extracting delete role util (not yet used)
2021-07-10 13:22:08 -04:00
Brandon Thomas
f24cdb6d38
store delete model IP address
2021-07-10 13:08:17 -04:00
Brandon Thomas
b8e4dadaf3
re-codegen after refactor
2021-07-10 01:38:13 -04:00
Brandon Thomas
db2b69fe53
fixup jobs from refactor
2021-07-10 01:37:38 -04:00
Brandon Thomas
103ef34b06
huge database module refactor, move under unified directory tree
2021-07-10 01:32:23 -04:00
Brandon Thomas
f58a4353dd
delete tts model
2021-07-09 22:20:36 -04:00
Brandon Thomas
beb68b5051
env var controls
2021-07-06 02:26:58 -04:00
Brandon Thomas
d2f0710097
cache strategies seem to work (too much logging though)
2021-07-06 02:22:13 -04:00
Brandon Thomas
f28e405f6d
tests on expiry
2021-07-05 23:30:57 -04:00
Brandon Thomas
424b98bb9d
rename cache strategizer, add forget duration (untested)
2021-07-05 23:24:53 -04:00
Brandon Thomas
9c447e0442
multithreaded version
2021-07-05 22:57:43 -04:00
Brandon Thomas
cd508ed946
cold cache tracking algorithm works
2021-07-05 22:16:36 -04:00
Brandon Thomas
453991f6d8
WIP cold cache strategy
2021-07-05 15:01:27 -04:00
Brandon Thomas
51ba9517d9
sort model names alphabetically
2021-07-05 11:46:29 -04:00
Brandon Thomas
bd289a06b3
wait on cold memory
2021-07-05 11:41:18 -04:00
Brandon Thomas
26be0594e8
control number of sidecar models
2021-07-05 10:41:14 -04:00
Brandon Thomas
b476485cd7
model loading/unloading works
2021-07-05 10:33:48 -04:00
Brandon Thomas
4da28003f2
attempt at running LRU for the sidecar
2021-07-05 02:18:20 -04:00
Brandon Thomas
304312ce6f
stupid string reference. Ugh.
2021-07-05 01:15:16 -04:00
Brandon Thomas
aced214213
lightweight LFU cache that returns the discarded key
2021-07-04 23:38:06 -04:00
Brandon Thomas
13c4f22e49
Perform TTS using a sidecar HTTP server
2021-07-03 01:35:36 -04:00
Brandon Thomas
5bc943a9f5
server seems to work!
2021-07-02 17:38:58 -04:00
Brandon Thomas
560beb0773
progress on loading models from multiple args
2021-07-02 17:27:02 -04:00
Brandon Thomas
321322c0a5
server is working and fast, but need to wire it up for API
2021-07-02 16:39:27 -04:00
Brandon Thomas
21ac34b8a5
wip
2021-07-02 04:21:31 -04:00
Brandon Thomas
3bbab7232c
Working on porting HTTP server from old project
...
https://github.com/ml-applications/voder/blob/7e33d9c7ca45bc4cd1d05011d5be4a4d035e9c82/cycle_gan/demo_server.py
2021-07-02 03:13:48 -04:00
Brandon Thomas
fada5e6b29
some cold caching logic - skip worker once if cache is cold
2021-06-30 17:09:18 -04:00
Brandon Thomas
00d95f9e88
no-op logger
2021-06-30 05:00:53 -04:00
Brandon Thomas
196efc52c1
"no-op logger" to reduce log spam
2021-06-30 04:58:03 -04:00
Brandon Thomas
e302fe834c
make easier to reconfigure
2021-06-27 18:07:53 -04:00
Brandon Thomas
9515a8c3cc
re-codegen db for badges in profile
2021-06-27 00:23:39 -04:00
Brandon Thomas
ca5a9cf0ef
add badges to profile endpoint
2021-06-27 00:23:03 -04:00
Brandon Thomas
679be23066
re-codegen db
2021-06-27 00:04:44 -04:00
Brandon Thomas
6b745fd3b0
user badges + user badge granter + integrated into grant call sites
2021-06-27 00:03:48 -04:00
Brandon Thomas
0ca7ceadab
completely reorganize readme
2021-06-26 20:21:20 -04:00
Brandon Thomas
949e707c7e
update 404, index, and alpha controllers
2021-06-26 14:19:57 -04:00
Brandon Thomas
c3464c4fe3
uppercase user tokens
2021-06-26 13:46:38 -04:00
Brandon Thomas
10f86bf513
revize tokens in the system
2021-06-26 13:09:29 -04:00
Brandon Thomas
68f355846f
didn't want to lose my github streak. ugh, work :(
2021-06-24 23:59:22 -04:00
Brandon Thomas
3b8aa0a7c6
more install instructions
2021-06-23 01:35:29 -04:00
Brandon Thomas
847bbb935c
python3.6 on apple m1 mac
2021-06-22 02:35:13 -04:00
Brandon Thomas
ee4be7dc94
instructions
2021-06-20 23:55:13 -04:00
Brandon Thomas
6b20a11595
install instructions for mac
2021-06-20 11:58:04 -04:00
Brandon Thomas
51bbdf61ba
Update README.md
2021-06-19 23:58:38 -04:00
Brandon Thomas
84444c3380
work on better tokens
2021-06-18 05:25:45 -04:00
Brandon Thomas
8d8209d1f8
get rid of a few columns (tts results)
2021-06-18 05:07:28 -04:00
Brandon Thomas
c406972175
store bucket uuid
2021-06-18 02:50:23 -04:00
Brandon Thomas
4ded82b3c7
fix path bug
2021-06-18 02:38:40 -04:00
Brandon Thomas
2f49daae78
fix column swap bug
2021-06-18 02:33:41 -04:00
Brandon Thomas
6af385dd48
normalize and correct cashapp
2021-06-17 03:10:18 -04:00
Brandon Thomas
a82572ee5b
normalize twitter username
2021-06-17 02:57:31 -04:00
Brandon Thomas
ceee067734
re-codegen db
2021-06-17 02:18:47 -04:00
Brandon Thomas
34c66465ce
mod-only response for w2l result
2021-06-17 01:53:12 -04:00
Brandon Thomas
8463a16fe1
remove extraneous logging
2021-06-17 01:47:31 -04:00
Brandon Thomas
02c1442e6c
mod fields for TTS results
2021-06-17 01:43:56 -04:00
Brandon Thomas
12466896e0
GET TTS model cleanup, add mod-only fields
2021-06-17 01:37:30 -04:00
Brandon Thomas
caac64c567
moderator-only fields for W2L templates
2021-06-17 01:05:06 -04:00
Brandon Thomas
38e1c4d692
fix routes
2021-06-16 23:43:53 -04:00
Brandon Thomas
98b71277ac
IP bans work!
2021-06-16 01:30:51 -04:00
Brandon Thomas
8b95ea3abd
ip filter middleware (not rejecting yet)
2021-06-16 00:45:51 -04:00
Brandon Thomas
b783fe5bcb
cleanup
2021-06-16 00:23:59 -04:00
Brandon Thomas
38ed9f6804
this works! ip ban polling async that doesn't stop interrupts
...
Need to clean this up now...
2021-06-16 00:17:41 -04:00
Brandon Thomas
e5d6528788
this works, but takes 30 seconds!
2021-06-15 01:38:04 -04:00
Brandon Thomas
c8818e7e3b
add ip ban polling thread (not yet wired up to executor)
2021-06-15 00:12:54 -04:00
Brandon Thomas
8776893774
ip address validation
2021-06-14 04:20:33 -04:00
Brandon Thomas
f25d731fc4
don't show deleted bans
2021-06-14 03:33:31 -04:00
Brandon Thomas
92fda195ec
get single IP ban info
2021-06-14 03:12:16 -04:00
Brandon Thomas
af11a1eddf
add mod details to ip address ban list
2021-06-14 02:46:25 -04:00
Brandon Thomas
4db289c3c0
codegen db
2021-06-13 06:31:07 -04:00
Brandon Thomas
2b1cf957c7
synthetic ids for w2l
2021-06-13 06:30:28 -04:00
Brandon Thomas
76c2fe446c
synthetic IDs for TTS
2021-06-13 06:17:43 -04:00
Brandon Thomas
31effd2ea8
synthetic ids work (but need finishing and cleanup)
2021-06-13 06:11:18 -04:00
Brandon Thomas
5c76623907
redis-based counts for w2l
2021-06-13 03:56:26 -04:00
Brandon Thomas
3d8da4598f
add model use counts
2021-06-13 03:39:09 -04:00
Brandon Thomas
323bf9ea8d
move bucket utils under ./utils so it's with similar stuff
2021-06-13 03:12:50 -04:00
Brandon Thomas
30dfe649ae
configure redis with env var
2021-06-13 03:04:04 -04:00
Brandon Thomas
c416069f69
write redis with tts use count (needs connection config)
2021-06-13 02:56:24 -04:00
Brandon Thomas
f21bac526c
add model title in tts results list
2021-06-13 01:58:12 -04:00
Brandon Thomas
b380a3197c
fix markdown from containing HTML !!!! also: temporary no-entropy cursors
2021-06-13 01:17:31 -04:00
Brandon Thomas
1a98e10a4f
fix
2021-06-12 19:13:40 -04:00
Brandon Thomas
6e4f1225a6
fix endpoint, fix bug, add tests (not tested in browser)
2021-06-11 23:41:35 -04:00
Brandon Thomas
255f54c39a
all predicates for W2L pagination (endpoint is no-op temporarily)
2021-06-11 23:27:03 -04:00
Brandon Thomas
a2e4098fd6
mod check (manually tested the cursors - they work!)
2021-06-11 22:12:17 -04:00
Brandon Thomas
75df0cda4a
cleanup (let's test if it works...)
2021-06-11 22:02:21 -04:00
Brandon Thomas
9aac3beb9c
query mechanics in the builder
2021-06-11 21:47:51 -04:00
Brandon Thomas
806339d295
tests for all predicates
2021-06-11 21:33:15 -04:00
Brandon Thomas
e7dc15d832
offset predicate
2021-06-11 21:26:14 -04:00
Brandon Thomas
981b2f746a
another predicate
2021-06-11 21:23:49 -04:00
Brandon Thomas
e7c3db608d
wip query builder
2021-06-11 21:10:17 -04:00
Brandon Thomas
ea64e212b3
sorting both ways seems to work
2021-06-11 20:49:32 -04:00
Brandon Thomas
76e3f96a86
fix tts dl job
2021-06-11 19:58:23 -04:00
Brandon Thomas
0713de8658
pagination from query string (untested)
2021-06-11 19:18:30 -04:00
Brandon Thomas
50b694f8e6
paginated queries
2021-06-11 18:58:37 -04:00
Brandon Thomas
be40729ee8
order by clause (not tested)
2021-06-11 18:45:00 -04:00
Brandon Thomas
adf3741d85
wip untested dynamic query builder for tts results
2021-06-11 04:52:03 -04:00
Brandon Thomas
c015f431b2
sort key crypto tool added to server
2021-06-11 03:34:56 -04:00
Brandon Thomas
84548abf76
entropy + tests
2021-06-11 03:29:15 -04:00
Brandon Thomas
af4c831aaa
sort key encrypter (so we don't leak how big our database is)
2021-06-11 03:23:56 -04:00
Brandon Thomas
4fe9305099
set user role handler (untested)
2021-06-11 02:38:20 -04:00
Brandon Thomas
d603b832cf
add staff list endpoint (untested)
2021-06-11 02:24:55 -04:00
Brandon Thomas
03d8b9ada2
list user roles endpoint (untested)
2021-06-11 00:54:35 -04:00
Brandon Thomas
1a341c5705
move moderation handler files
2021-06-11 00:31:30 -04:00
Brandon Thomas
c985269953
list bans endpoint (not tested)
2021-06-11 00:11:21 -04:00
Brandon Thomas
1be0d3b0eb
use to_simple_json_error to replace all old, verbose constructions
2021-06-10 23:38:40 -04:00
Brandon Thomas
a3cb58e716
delete/undelete ip address ban handler
2021-06-10 23:25:55 -04:00
Brandon Thomas
214f048967
add ip ban handler (untested); stubs for other endpoints
2021-06-10 23:06:46 -04:00
Brandon Thomas
10a84b624e
no mod comments on inference results
2021-06-10 22:13:03 -04:00
Brandon Thomas
848233b6fa
add mod details editing to w2l templates
2021-06-10 22:01:02 -04:00
Brandon Thomas
544c61b0a8
add one more field
2021-06-10 21:53:27 -04:00
Brandon Thomas
fe75726e04
add moderator fields to edit_tts_model endpoint
2021-06-10 21:49:15 -04:00
Brandon Thomas
812f43254c
fix code to deal with moderation field renames and deletes
2021-06-10 14:18:14 -04:00
Brandon Thomas
653fa93c8a
Don't need these colums / column renames
2021-06-10 14:08:16 -04:00
Brandon Thomas
8e633ee5c5
propagate schema changes through to code (all binaries run) not tested
2021-06-10 04:59:42 -04:00
Brandon Thomas
728e7363f2
get rid of indices against deleted columns
2021-06-10 04:06:52 -04:00
Brandon Thomas
8eebffd7fe
more schema changes
2021-06-10 04:03:49 -04:00
Brandon Thomas
2c6172eb88
don't need these
2021-06-10 03:54:00 -04:00
Brandon Thomas
3b8c1e7531
more schema changes (code breaking)
2021-06-10 03:46:46 -04:00
Brandon Thomas
c2a6663e87
more user model changes (code breaking changes)
2021-06-10 03:20:46 -04:00
Brandon Thomas
12ebee4523
changes to user (code breaking)
2021-06-10 03:12:22 -04:00
Brandon Thomas
9587d2a548
major tts/w2l schema changes (won't compile / broken code)
2021-06-10 03:00:23 -04:00
Brandon Thomas
bdc6e6d1e9
cleanup get_tts_result endpoint to use shared queries
2021-06-10 02:04:36 -04:00
Brandon Thomas
1496090142
tts inference result delete endpoint (untested)
2021-06-10 01:59:56 -04:00
Brandon Thomas
0a1aa0aeab
forbid private types in public
2021-06-10 01:49:18 -04:00
Brandon Thomas
727c57ddaa
delete w2l results endpoint (not tested)
2021-06-10 01:45:36 -04:00
Brandon Thomas
dfb552abfc
prevent locked templates/models from being edited by non-mods
2021-06-10 00:38:22 -04:00
Brandon Thomas
3065f20f9f
add endpoint for editing tts models (untested)
2021-06-10 00:29:38 -04:00
Brandon Thomas
ec1e280eda
new edit w2l endpoint (untested) + http helper functions
2021-06-10 00:11:40 -04:00
Brandon Thomas
72a0ca01d9
seed with new permissions
2021-06-09 22:41:22 -04:00
Brandon Thomas
5cee2f4c5e
more permissions
2021-06-09 22:37:28 -04:00
Brandon Thomas
7d1d1c1791
add new permissions (unused)
2021-06-09 22:27:12 -04:00
Brandon Thomas
2fcae0a39c
fixup all queries for user_deleted_at / mod_deleted_at (untested)
2021-06-09 22:05:42 -04:00
Brandon Thomas
318221549b
columns to prevent user modification
2021-06-09 04:36:45 -04:00
Brandon Thomas
2d776517cc
delete schemas, two types of deleted record (WIP - code broken)
2021-06-09 04:33:32 -04:00
Brandon Thomas
342f9cd10e
new tables
2021-06-09 04:15:11 -04:00
Brandon Thomas
4485cf34d4
add attempt_count to all job status endpoints
2021-06-08 12:12:42 -04:00
Brandon Thomas
c9a82d46eb
prevent slurs in username and w2l titles
2021-06-08 12:02:29 -04:00
Brandon Thomas
8393095be2
job dead letter queueing (attempt count + config)
2021-06-08 03:16:04 -04:00
Brandon Thomas
b01b83cccf
job max attempts
2021-06-08 03:05:31 -04:00
Brandon Thomas
e83c003320
central config for batch query timeout
2021-06-08 02:49:11 -04:00
Brandon Thomas
1bc18487f0
sort results
2021-06-08 01:58:17 -04:00
Brandon Thomas
40b029274e
re-codegen db
2021-06-08 01:56:37 -04:00
Brandon Thomas
e7018c085b
w2l inference job locks (not tested)
2021-06-08 01:55:57 -04:00
Brandon Thomas
f088116dfa
job lock for w2l downloader (not tested)
2021-06-08 01:51:57 -04:00
Brandon Thomas
c08000d11a
lock on tts download job (not tested)
2021-06-08 01:42:49 -04:00
Brandon Thomas
23801d90f6
remove debug log
2021-06-08 01:08:39 -04:00
Brandon Thomas
9ce83025b4
mutual exclusion seems to work well!
2021-06-08 00:47:41 -04:00
Brandon Thomas
373726b685
this locking appears to work (testing)
2021-06-08 00:36:23 -04:00
Brandon Thomas
b6bd4ab68c
fix debugging script
2021-06-07 23:57:21 -04:00
Brandon Thomas
af80527c47
Check TT2 model for validity and store file size
2021-06-07 22:56:56 -04:00
Brandon Thomas
df765663eb
good permissions settings for w2l templates!
2021-06-07 03:11:11 -04:00
Brandon Thomas
824324f204
expose delete handler
2021-06-07 02:53:08 -04:00
Brandon Thomas
7bec75e755
fix for mods
2021-06-07 02:23:30 -04:00
Brandon Thomas
93ac3c6c49
fix edit profile bug
2021-06-07 02:22:01 -04:00
Brandon Thomas
71e5eb3492
scripts to toggle userroles
2021-06-07 02:06:30 -04:00
Brandon Thomas
3d23461863
fix seed script
2021-06-07 02:06:12 -04:00
Brandon Thomas
76b1e9ffed
codegen
2021-06-07 01:58:45 -04:00
Brandon Thomas
e62fffe11f
delete endpoint; revised permissions
2021-06-07 01:58:15 -04:00
Brandon Thomas
8143409ada
moderate endpoint exposed
2021-06-07 01:19:57 -04:00
Brandon Thomas
8642674481
codegen
2021-06-07 00:48:10 -04:00
Brandon Thomas
7d02dc5e00
rename column
2021-06-07 00:47:42 -04:00
Brandon Thomas
94f8ab15bc
reuse select query
2021-06-07 00:39:23 -04:00
Brandon Thomas
13e2e32ca5
wip on moderation of templates
2021-06-07 00:32:15 -04:00
Brandon Thomas
9495798583
template mod approval -> tri state, db helpers
2021-06-06 23:13:19 -04:00
Brandon Thomas
b6a8c40ddb
add to get profile handler
2021-06-06 19:18:40 -04:00
Brandon Thomas
abc8264304
more info from session endpoint
2021-06-06 17:52:07 -04:00
Brandon Thomas
0cc67e3107
no more annoying warnings
2021-06-06 17:44:32 -04:00
Brandon Thomas
b513dddbb6
re-codegen db
2021-06-06 17:41:53 -04:00
Brandon Thomas
8639d7b804
fixup initial role
2021-06-06 17:40:12 -04:00
Brandon Thomas
bc3fee54d6
actual permissions
2021-06-06 17:36:43 -04:00
Brandon Thomas
5ec3c9cc3c
seed script to populate user_roles
2021-06-06 17:33:47 -04:00
Brandon Thomas
6274250fbf
fixup website validations
2021-06-06 17:25:08 -04:00
Brandon Thomas
4bc948d0ac
A ton of new functionality to support editing profiles
2021-06-06 17:23:39 -04:00
Brandon Thomas
802a348fb5
re-codegen queries
2021-06-06 00:56:43 -04:00
Brandon Thomas
d7a9f88493
status check endpoint for w2l upload
2021-06-06 00:14:51 -04:00
Brandon Thomas
004bc71e96
TTS upload job status
2021-06-05 23:49:16 -04:00
Brandon Thomas
7638c640ff
move profile URL
2021-06-05 23:37:28 -04:00
Brandon Thomas
3aded66c09
ban slurs from being said
2021-06-05 16:38:19 -04:00
Brandon Thomas
d5ed1d9c3b
add result fields to upload jobs
2021-06-05 16:08:59 -04:00
Brandon Thomas
dfc52681cd
calculate audio metadata
2021-06-05 15:47:21 -04:00
Brandon Thomas
9c1a1e88f9
simplify mel generation
2021-06-05 15:36:30 -04:00
Brandon Thomas
f804d0216b
some form of spectrogram
2021-06-05 14:13:31 -04:00
Brandon Thomas
000f3b9ef5
put spectrogram into correct dimensions
2021-06-04 03:58:17 -04:00
Brandon Thomas
ec450230f8
saves spectrogram json and uploads it!
2021-06-04 03:54:02 -04:00
Brandon Thomas
47c391571a
update docs on denying public listing on public buckets
2021-06-04 03:39:31 -04:00
Brandon Thomas
ce6c39b6c7
respond with expected response
2021-06-04 03:20:23 -04:00
Brandon Thomas
91f37486e2
update job completion result token
2021-06-04 02:51:11 -04:00
Brandon Thomas
f14a935012
new endpoint to report w2l inference status
2021-06-04 02:46:18 -04:00
Brandon Thomas
870eba8a9c
improvements
2021-06-04 02:06:52 -04:00
Brandon Thomas
cda1bbda41
return bucket path
2021-06-04 00:50:24 -04:00
Brandon Thomas
19473726c6
endpoint to report status of tts inference
2021-06-03 20:06:43 -04:00
Brandon Thomas
0202dd4d43
fix response key
2021-06-03 17:25:13 -04:00
Brandon Thomas
e2e7950dd9
build fixed
2021-06-03 03:11:07 -04:00
Brandon Thomas
9a4a8fd23a
fixed? still errors...
2021-06-03 03:07:14 -04:00
Brandon Thomas
6702b42808
more fixed
2021-06-03 02:50:04 -04:00
Brandon Thomas
e8dc191d8e
fix four more errors
2021-06-03 02:44:17 -04:00
Brandon Thomas
3022193ff7
fixed errors on one endpoint
2021-06-03 02:35:31 -04:00
Brandon Thomas
a9aa0a5b50
(BROKEN): WIP new endpoints for TTS models, results, etc.
2021-06-03 02:14:19 -04:00
Brandon Thomas
ae32779c35
reserve one-letters and a few more
2021-06-03 01:10:10 -04:00
Brandon Thomas
7904f6e56b
sorted, dupes removed
2021-06-03 01:04:27 -04:00
Brandon Thomas
7b833d7c66
more reserved words
2021-06-03 01:03:34 -04:00
Brandon Thomas
57ae2343dd
stupid, but makes me smile
2021-06-02 23:37:06 -04:00
Brandon Thomas
71a19e4794
re-codegen db
2021-06-02 23:22:04 -04:00
Brandon Thomas
716a75c4f4
THAT DID THE TRICK! I was using the wrong wav encoding!
2021-06-02 22:35:08 -04:00
Brandon Thomas
a1c77fb527
Copying waveglow files @ 2fd4e63 (per collab synthesis.ipynb)
2021-06-02 22:26:55 -04:00
Brandon Thomas
7744f0e324
working on adapting the waveglow/inference to sound non-noisy
2021-06-02 22:17:27 -04:00
Brandon Thomas
077a4239d8
sounds better, but still bad
2021-06-02 21:53:30 -04:00
Brandon Thomas
ae91e19b9f
fixup filename, debugging
2021-06-02 21:15:33 -04:00
Brandon Thomas
9d46818a56
fixup
2021-06-02 21:06:30 -04:00
Brandon Thomas
ef994670f2
fixed bugs introduced
2021-06-02 20:59:40 -04:00
Brandon Thomas
cf20f1a558
Add text hash to tts_results; also mistakenly merge branch 'master'
...
Ugh, how did I get a merge into my working branch without noticing? and
there were merge conflicts!!
2021-06-02 20:44:10 -04:00
Brandon Thomas
3f1a5fa729
hack, kind of works.
...
Wav doesn't play in firefox, vlc. Only asound. It sounds awful.
Need to fix paths and so many other things
2021-06-02 00:55:28 -04:00
Brandon Thomas
7003e5431e
better, but still not working
2021-06-02 00:48:42 -04:00
Brandon Thomas
dadb26c5f2
path bugfixing (still not working)
2021-06-02 00:28:54 -04:00
Brandon Thomas
22de06afe0
fixup local env vars
2021-06-01 16:23:06 -04:00
Brandon Thomas
46f878beaa
tts inference script
2021-06-01 16:21:03 -04:00
Brandon Thomas
86b9d2ecca
fixup tts_inference_job (python still needs writing)
2021-06-01 14:29:40 -04:00
Brandon Thomas
a0919fffee
overhaul tts_job
2021-06-01 14:23:16 -04:00
Brandon Thomas
0f2da6f6e5
fix column name
2021-06-01 13:32:53 -04:00
Brandon Thomas
79f8b0ad7f
add bucket paths for TTS (untested)
2021-06-01 03:02:05 -04:00
Brandon Thomas
5a1dafdc21
local filesystem paths
2021-06-01 02:17:54 -04:00
Brandon Thomas
05c9eff1c5
TTS inference queries+codegen, job/script WIP
2021-06-01 02:03:52 -04:00
Brandon Thomas
164cb46fff
add debug print to tts inference script
2021-05-31 23:42:29 -04:00
Brandon Thomas
446983a477
another video
2021-05-31 23:40:59 -04:00
Brandon Thomas
ff9c8e73e4
seed tts models, youtube videos
2021-05-31 23:21:22 -04:00
Brandon Thomas
2e61978258
more firehose events and add new column!
2021-05-31 22:50:03 -04:00
Brandon Thomas
14a918a9c6
update endpoint to set token and require idempotency token
2021-05-31 22:22:48 -04:00
Brandon Thomas
335d355d64
add w2l deps, update readme
2021-05-31 21:45:45 -04:00
Brandon Thomas
16f6e6ebef
use a shared common default log-level and db password
2021-05-31 20:44:59 -04:00
Brandon Thomas
e224eee89f
FREAKING HUGE MYSQL IN DEV YAK SHAVE
2021-05-31 20:24:50 -04:00
Brandon Thomas
236b1210e6
simplify python install
2021-05-31 18:34:38 -04:00
Brandon Thomas
8574ed0796
fix dockerfile
2021-05-31 18:32:48 -04:00
Brandon Thomas
e31a5557b6
add working requirements
2021-05-31 18:29:03 -04:00
Brandon Thomas
5f77848304
wav inference works e2e! It's got staticy output, works!
2021-05-31 17:58:21 -04:00
Brandon Thomas
f23ceb22bf
add waveglow @ master
2021-05-31 17:53:42 -04:00
Brandon Thomas
79f7c6c82d
mel histograms look good! (this is just a test)
2021-05-31 17:38:56 -04:00
Brandon Thomas
49dde0a2ff
Add utility from my old experimentation (details)
...
~/dev/3rd/nvidia-tacotron2
commit f6be28d1f89b5e0bae89a771c5d116722f8661cb
Author: Brandon Thomas <echelon@gmail.com >
Date: Sat Jan 11 01:24:26 2020 -0500
Running on CPU, also wav images
2021-05-31 17:36:43 -04:00
Brandon Thomas
04bdfa77fb
spectrogram inference works !
2021-05-31 17:33:09 -04:00
Brandon Thomas
34940f75b1
inference wip
2021-05-31 17:26:32 -04:00
Brandon Thomas
14f1fd327c
requirements from halide that seem to be almost working
2021-05-31 17:21:55 -04:00
Brandon Thomas
21c2194828
additional comment
2021-05-31 16:53:25 -04:00
Brandon Thomas
a423cf6de9
a bunch of alternative requirements files
2021-05-31 16:52:41 -04:00
Brandon Thomas
b98f250c07
debug sleep for w2l download job
2021-05-31 15:45:40 -04:00
Brandon Thomas
9b0f6badce
rename download script
2021-05-31 14:54:21 -04:00
Brandon Thomas
81ab8797d3
add python's youtube-dl
2021-05-31 14:43:18 -04:00
Brandon Thomas
6f1cf06dd6
Merge branch 'master' of github.com:storytold/storyteller-web
2021-05-31 14:42:20 -04:00
Brandon Thomas
a9aa9c692f
improve download script
2021-05-31 14:42:10 -04:00
Brandon Thomas
7bca17ad73
put tacotron in the correct place
2021-05-30 16:47:54 -04:00
Brandon Thomas
ccd9a69ad7
build with cached base image (test)
...
let's see if this goes faster
2021-05-30 16:43:35 -04:00
Brandon Thomas
6201f5c49a
install nvidia drivers
2021-05-30 16:03:44 -04:00
Brandon Thomas
3b5c0b70eb
add pciutils
2021-05-30 15:30:04 -04:00
Brandon Thomas
8abe0eee62
notes
2021-05-30 15:24:26 -04:00
Brandon Thomas
a05b1ed551
revert Wav2Lip using Python3.6 with a PPA hack
2021-05-30 14:41:39 -04:00
Brandon Thomas
eee60e3cdd
upgrade python package
2021-05-30 13:44:43 -04:00
Brandon Thomas
1d097c1a64
update dockerfile
2021-05-30 13:38:54 -04:00
Brandon Thomas
d52bdc6a10
update dockerfile
2021-05-30 13:34:07 -04:00
Brandon Thomas
18830fea61
I needed to actually re-specify .gitignore to not pass to docker ctx
2021-05-30 13:22:57 -04:00
Brandon Thomas
e0479aa1da
Change dockerfile base image
2021-05-30 13:14:55 -04:00
Brandon Thomas
5e0a1d2e7d
Fix dockerfile again
2021-05-30 07:04:42 -04:00
Brandon Thomas
41fc0ee1ec
fix requirements?
2021-05-30 06:45:57 -04:00
Brandon Thomas
8655e99e43
fix dockerfile &&
2021-05-30 06:19:16 -04:00
Brandon Thomas
943047e59c
an old "inference" script I found seems to work :whatever:
2021-05-30 06:09:33 -04:00
Brandon Thomas
ecc2c3bec6
I installed my own requirements.txt somehow not realizing it was there
...
what
2021-05-30 04:55:49 -04:00
Brandon Thomas
79a21570e9
re-codegen queries
2021-05-30 04:50:06 -04:00
Brandon Thomas
f5f5a8dd93
add tacotron2
2021-05-30 04:27:51 -04:00
Brandon Thomas
fd2b01334b
more firehose event types
2021-05-30 04:12:32 -04:00
Brandon Thomas
f27908d4a2
add gravatar hash
2021-05-30 03:50:58 -04:00
Brandon Thomas
6ab5bac9dc
add events endpoint
2021-05-30 03:02:47 -04:00
Brandon Thomas
f601ec9aa1
events for several things
2021-05-30 02:41:17 -04:00
Brandon Thomas
fca64a6cca
firehose publishing
2021-05-30 02:12:27 -04:00
Brandon Thomas
b3a0b49bc1
report gravatar and template creator for inf result
2021-05-30 00:42:22 -04:00
Brandon Thomas
e84070f5bb
add video bucket path
2021-05-30 00:35:24 -04:00
Brandon Thomas
ea566c465e
new endpoint to show singular inference results
2021-05-29 23:44:18 -04:00
Brandon Thomas
4f62a865a5
add title
2021-05-29 21:17:42 -04:00
Brandon Thomas
910b3db1eb
update seed tool
2021-05-29 20:47:59 -04:00
Brandon Thomas
510c8ed09b
add a seed script that populates a lot more data
2021-05-29 20:29:17 -04:00
Brandon Thomas
b6c54f23fa
fix username bug
2021-05-29 20:12:56 -04:00
Brandon Thomas
bef1036d40
session debugging
2021-05-29 19:59:00 -04:00
Brandon Thomas
cf060ea1ff
user inference result endpoint (wip)
2021-05-29 19:15:47 -04:00
Brandon Thomas
f90839f87f
fix query, share code
2021-05-29 16:29:27 -04:00
Brandon Thomas
42d221bd79
endpoint to list w2l templates
2021-05-29 16:25:55 -04:00
Brandon Thomas
ece7d66e58
end bump
2021-05-29 15:12:11 -04:00
Brandon Thomas
dbca8e7fd9
add tokens to upload jobs, reorganize schemas, codegen
2021-05-29 14:40:04 -04:00
Brandon Thomas
063780db3a
this might be close...
2021-05-29 14:13:36 -04:00
Brandon Thomas
2d7f46cc57
progress, but broke one of the jobs
2021-05-29 13:58:06 -04:00
Brandon Thomas
a8211a1f9b
this fixes duration metadata
2021-05-29 13:20:50 -04:00
Brandon Thomas
9075f97d7a
output metadata (wrongish?)
2021-05-29 13:03:19 -04:00
Brandon Thomas
6ceed517de
end filename
2021-05-29 12:36:45 -04:00
Brandon Thomas
f886cecf8d
it works?? I need to save the results somewhere
2021-05-29 12:20:46 -04:00
Brandon Thomas
62b6b70e36
download template media, start work on process script
2021-05-29 12:07:05 -04:00
Brandon Thomas
6d7f9ba872
inference job (doesn't work)
2021-05-29 02:41:57 -04:00
Brandon Thomas
b4b8222649
download audio
2021-05-29 02:27:16 -04:00
Brandon Thomas
e2cc57dd1e
change name
2021-05-29 01:28:38 -04:00
Brandon Thomas
9e9c4deb34
download face templates
2021-05-29 01:11:40 -04:00
Brandon Thomas
4a706cf5a7
improve ergonomics
2021-05-28 23:46:52 -04:00
Brandon Thomas
0924dd7cc3
download w2l model to persist dir
2021-05-28 23:31:47 -04:00
Brandon Thomas
125b60b508
builds again
2021-05-28 22:43:05 -04:00
Brandon Thomas
e629166da3
filesystem path tool, tests pass again
2021-05-28 22:11:01 -04:00
Brandon Thomas
843b9755a1
two types of path
2021-05-28 21:20:48 -04:00
Brandon Thomas
e2a9bf81e5
fix bug
2021-05-28 21:06:38 -04:00
Brandon Thomas
69fba14fa4
no longer fails to compile (but w2l inference is broken)
2021-05-28 21:05:49 -04:00
Brandon Thomas
c11ccc36d7
WIP on w2l inference job (doesn't compile)
2021-05-28 20:32:58 -04:00
Brandon Thomas
226019b09f
store metadata and mime types
2021-05-28 02:45:05 -04:00
Brandon Thomas
95b5fa8daa
switch to using prefix tokens
2021-05-28 02:26:47 -04:00
Brandon Thomas
abfd1a69e5
rename crockford functions, fix tests, change prefix
2021-05-28 02:16:50 -04:00
Brandon Thomas
79be37a60c
upload audio to bucket
2021-05-28 02:10:30 -04:00
Brandon Thomas
3eea12e45b
fix bucket length limitation
2021-05-28 01:36:54 -04:00
Brandon Thomas
5c5039c999
successful inference job creation
2021-05-28 01:26:59 -04:00
Brandon Thomas
074b985222
wip create w2l inference job
2021-05-28 01:00:36 -04:00
Brandon Thomas
eecaa07638
fix/rename templates -> models
2021-05-27 19:23:00 -04:00
Brandon Thomas
5eda3a9ed3
list models
2021-05-27 19:14:41 -04:00
Brandon Thomas
6a717d386e
withold reserved usernames
2021-05-27 13:56:12 -04:00
Brandon Thomas
88305f5d10
functions to check resreved usernames
2021-05-27 13:53:01 -04:00
Brandon Thomas
62b85a1166
more
2021-05-27 12:49:04 -04:00
Brandon Thomas
d4800f8b62
merge lists
2021-05-27 12:47:06 -04:00
Brandon Thomas
eb3c327dde
another list
2021-05-27 12:46:23 -04:00
Brandon Thomas
75735ce3c7
more custom words
2021-05-27 12:44:31 -04:00
Brandon Thomas
4a8e2a00cd
remove dupes
2021-05-27 12:33:08 -04:00
Brandon Thomas
21d3210f66
more custom words
2021-05-27 12:32:32 -04:00
Brandon Thomas
cdc271f70a
new list + few of my own
2021-05-27 12:31:15 -04:00
Brandon Thomas
cfd1401b7f
a few custom words
2021-05-27 12:25:26 -04:00
Brandon Thomas
6182c07d6a
remove dupes
2021-05-27 12:24:13 -04:00
Brandon Thomas
571f5e8a29
combine lists
2021-05-27 12:23:07 -04:00
Brandon Thomas
6262588697
reserved db (wip)
2021-05-27 12:21:27 -04:00
Brandon Thomas
27adcb5d7f
populate with lots of templates from the web
2021-05-27 12:06:07 -04:00
Brandon Thomas
363d47bcef
GET template
2021-05-27 12:05:55 -04:00
Brandon Thomas
753e0edce6
list w2l templates
2021-05-27 01:47:37 -04:00
Brandon Thomas
395f3694b1
simplify bucket hashes
2021-05-27 01:12:17 -04:00
Brandon Thomas
765d4b597d
record w2l file size
2021-05-27 00:56:52 -04:00
Brandon Thomas
594eb0f126
add more fields to the database
2021-05-26 22:50:47 -04:00
Brandon Thomas
c0f74bad3d
return gravatar with session
2021-05-26 11:11:38 -04:00
Brandon Thomas
be87c4b281
add gravatar to db
2021-05-26 11:02:49 -04:00
Brandon Thomas
204e1ecd88
gravatars
2021-05-26 10:54:28 -04:00
Brandon Thomas
0d634896a1
profile endpoint
2021-05-26 02:40:28 -04:00
Brandon Thomas
3ce65d8c25
improve alpha mode enrollment
2021-05-25 03:19:20 -04:00
Brandon Thomas
f536ce02cf
ignore sqlx logging
2021-05-25 03:07:22 -04:00
Brandon Thomas
40f403be69
messy, but upload to PUBLIC + PRIVATE buckets
2021-05-25 03:03:52 -04:00
Brandon Thomas
1da4ab5588
fix imagemagick resize
2021-05-25 02:46:14 -04:00
Brandon Thomas
43736d01e2
get original file mimetype
2021-05-25 02:40:27 -04:00
Brandon Thomas
6b73255eae
install imagemagick
2021-05-25 02:18:11 -04:00
Brandon Thomas
107f14104e
imagemagick works better!
2021-05-25 02:17:29 -04:00
Brandon Thomas
aa493ad197
generate preview image (fails though...)
2021-05-25 02:09:36 -04:00
Brandon Thomas
6afe1c168b
save duration millis
2021-05-25 01:50:02 -04:00
Brandon Thomas
6036934dd9
looping webp
2021-05-25 01:39:20 -04:00
Brandon Thomas
d45b1f6fb2
ffmpeg to generate video previews!
2021-05-25 01:27:26 -04:00
Brandon Thomas
aacc6e5fb9
Read file metadata and populate DB
2021-05-25 00:54:49 -04:00
Brandon Thomas
a534940509
test with video
2021-05-24 23:41:02 -04:00
Brandon Thomas
fa4a43c891
notes
2021-05-24 23:39:04 -04:00
Brandon Thomas
003f35b0ba
stop logspam
2021-05-24 20:21:49 -04:00
Brandon Thomas
9cdd6aa4b3
check that both files exist before upload
2021-05-24 20:10:04 -04:00
Brandon Thomas
5ea3398151
query to test
2021-05-24 19:37:32 -04:00
Brandon Thomas
46b613fef2
uploading image template processed faces works!
2021-05-24 19:37:04 -04:00
Brandon Thomas
6a07f5f91d
Preprocess W2L uploads (but glitchy)
2021-05-24 19:22:40 -04:00
Brandon Thomas
066cd01dd9
remove unnecessary steps from preprocessing
2021-05-24 15:11:40 -04:00
Brandon Thomas
2727afd644
Getting ready to process W2L uploads...
2021-05-24 15:00:10 -04:00
Brandon Thomas
f77563e03e
major dockerfile overhaul
2021-05-24 03:40:17 -04:00
Brandon Thomas
7622c9b0e3
update gitignore
2021-05-24 03:21:31 -04:00
Brandon Thomas
b2dcdbbaea
add codegen cache for new queries
2021-05-24 03:21:03 -04:00
Brandon Thomas
a8f969dc55
add READMEs for w2l
2021-05-24 03:19:33 -04:00
Brandon Thomas
effe301d23
Add adapted Wav2Lip from https://github.com/ml-applications/wav2lip-edge
2021-05-24 03:17:53 -04:00
Brandon Thomas
4993707316
remove args that won't be used
2021-05-24 03:12:48 -04:00
Brandon Thomas
0f4d4e9cd4
add w2l command (not yet in use)
2021-05-24 03:07:08 -04:00
Brandon Thomas
0378735ac3
refactor to use shared script wrapper
2021-05-24 02:35:33 -04:00
Brandon Thomas
281283ed8b
extract gdown command wrapper
2021-05-24 02:32:28 -04:00
Brandon Thomas
7e15d675b6
refactor more
2021-05-24 02:14:11 -04:00
Brandon Thomas
b958b8badf
refactoring
2021-05-24 02:05:47 -04:00
Brandon Thomas
a4f3a06f3c
refactoring
2021-05-24 01:59:27 -04:00
Brandon Thomas
ab946489cf
upload w2l (minus face dtection and fancy things)
2021-05-24 01:18:56 -04:00
Brandon Thomas
9aae3faab3
more common pieces
2021-05-24 00:54:04 -04:00
Brandon Thomas
5d132c8277
add more bucket stuff, w2l/tts upload jobs
2021-05-24 00:42:06 -04:00
Brandon Thomas
366bba97cb
store object name
2021-05-23 13:43:50 -04:00
Brandon Thomas
a7e47951e6
working path
2021-05-23 13:35:50 -04:00
Brandon Thomas
c9978cecda
TOKIO DOWNGRADE 1.0 -> 0.2; this fixes Bucket/S3 error
2021-05-23 13:33:01 -04:00
Brandon Thomas
50de9cfbf2
file bug report
2021-05-23 13:26:25 -04:00
Brandon Thomas
73849e825f
still not working in subdirs...
2021-05-23 12:01:15 -04:00
Brandon Thomas
e9ad9bbfe0
switch back to tokio, this works onlyfor non-dirs
2021-05-23 04:39:55 -04:00
Brandon Thomas
68aeded077
This upload worked (filename causes failure!)
2021-05-23 03:40:57 -04:00
Brandon Thomas
4d9fb18066
bucket uploads with correct runtime (but getting 403 forbid)
2021-05-23 02:52:26 -04:00
Brandon Thomas
bf3c0c19da
bucket client (but needs tokio runtime!)
2021-05-23 02:31:31 -04:00
Brandon Thomas
a484207eb6
copy url
2021-05-22 09:02:02 -04:00
Brandon Thomas
bb2c189c56
file hashing
2021-05-22 08:54:21 -04:00
Brandon Thomas
44d1d5bf5e
update dockerfile
2021-05-22 08:18:17 -04:00
Brandon Thomas
0f366884f0
fix dockerfile ?
2021-05-22 08:04:43 -04:00
Brandon Thomas
9a9812f379
downloader works
2021-05-22 07:59:45 -04:00
Brandon Thomas
2695567ef6
closer
2021-05-22 07:52:43 -04:00
Brandon Thomas
878acbad76
forgot these queries
2021-05-22 07:37:20 -04:00
Brandon Thomas
c0767a1ba1
fixup compile/remove google drive stuff
2021-05-22 07:26:37 -04:00
Brandon Thomas
11c4e78ea8
hack to install gdown and scripts in dockerfile (TODO: use venv)
2021-05-22 07:20:21 -04:00
Brandon Thomas
b165996f9d
use python 'gdown' to download files
2021-05-22 07:17:39 -04:00
Brandon Thomas
fbf5b2513a
ugh, this requires tokio runtime and hyper is inflexible
2021-05-22 05:01:13 -04:00
Brandon Thomas
09a6aa286d
filesystem tempdir
2021-05-22 04:28:29 -04:00
Brandon Thomas
a235aa9f88
insert tts model
2021-05-22 04:14:39 -04:00
Brandon Thomas
232f66eb69
runs jobs to exhaustion
2021-05-22 03:57:07 -04:00
Brandon Thomas
b93f8a8099
progress
2021-05-22 03:49:18 -04:00
Brandon Thomas
4a3a39e5e1
Bake in job-related queries to build
2021-05-22 02:47:42 -04:00
Brandon Thomas
bc1ccbc176
job can query results!
2021-05-22 02:36:10 -04:00
Brandon Thomas
5bd14c1127
4 jobs + docker builds of each
2021-05-22 01:58:59 -04:00
Brandon Thomas
e154faaf32
add idempotency tokens to upload endpoints
2021-05-21 05:12:53 -04:00
Brandon Thomas
ddf445701d
refactor filenames
2021-05-21 00:03:18 -04:00
Brandon Thomas
fa546eac05
tts inference enqueue job + test scripts
2021-05-21 00:00:35 -04:00
Brandon Thomas
235d86ca2b
refactor how endpoints are grouped
2021-05-20 23:42:54 -04:00
Brandon Thomas
f4437cfe0a
debug scripts
2021-05-20 23:33:18 -04:00
Brandon Thomas
8c6a2c84e3
create w2l inference jobs (unchecked)
2021-05-20 23:29:28 -04:00
Brandon Thomas
4748cf6fd0
upload w2l job handler
2021-05-20 22:15:50 -04:00
Brandon Thomas
40c17a6337
create upload tts job
2021-05-20 21:53:30 -04:00
Brandon Thomas
f1ac70f6fe
model refinements
2021-05-20 20:22:47 -04:00
Brandon Thomas
b4ce8dfaf7
model refinements
2021-05-20 20:19:59 -04:00
Brandon Thomas
23cdeaddf6
model refinements
2021-05-20 20:12:17 -04:00
Brandon Thomas
173102f1d8
more model refinements
2021-05-20 19:52:15 -04:00
Brandon Thomas
9cb3122723
model updates
2021-05-20 19:36:08 -04:00
Brandon Thomas
bcc83df3bf
model refinements
2021-05-20 19:24:14 -04:00
Brandon Thomas
61c583753e
schema updates
2021-05-20 18:36:14 -04:00
Brandon Thomas
bedfe75355
enable-alpha cookie endpoint
2021-05-20 02:35:34 -04:00
Brandon Thomas
5e434498ac
configurable bind address
2021-05-20 00:32:05 -04:00
Brandon Thomas
6a04f03f32
404 route
2021-05-20 00:14:40 -04:00
Brandon Thomas
1979d604b0
index page
2021-05-20 00:07:40 -04:00
Brandon Thomas
793fd30c79
document production migrations
2021-05-19 20:49:57 -04:00
Brandon Thomas
74c67ee132
Use nativetls (production issue?) and add nginx docs
2021-05-19 20:29:57 -04:00
Brandon Thomas
bdd196308b
more logging
2021-05-19 01:50:25 -04:00
Brandon Thomas
15ed33d1c4
bump
2021-05-19 00:51:45 -04:00
Brandon Thomas
122f431bde
fixup dockerfile
2021-05-19 00:41:14 -04:00
Brandon Thomas
e0150a844a
update readme with instructions
2021-05-19 00:36:41 -04:00
Brandon Thomas
7ad7437ef5
bump
2021-05-19 00:31:50 -04:00
Brandon Thomas
c1fc3728c3
Add docker file
2021-05-19 00:24:32 -04:00
Brandon Thomas
29f815578f
update readme
2021-05-19 00:16:26 -04:00
Brandon Thomas
498ff80a5c
Cache SQLX database info so it'll build without DB
2021-05-19 00:15:35 -04:00
Brandon Thomas
06d597ebc5
.env for local dev and sqlx builds
2021-05-18 23:58:31 -04:00
Brandon Thomas
d74cc614b8
cleanup
2021-05-18 23:50:48 -04:00
Brandon Thomas
0f68ce115b
session state persists; using nginx as local dev proxy
2021-05-18 06:16:39 -04:00
Brandon Thomas
c264f09ee2
improve session endpoint
2021-05-18 01:52:52 -04:00
Brandon Thomas
03b4e92d3a
session info handler
2021-05-18 00:57:53 -04:00
Brandon Thomas
57e3fc4ebe
session checker, etc. etc.
2021-05-18 00:37:41 -04:00
Brandon Thomas
b7659d5b5d
better script output
2021-05-17 23:42:35 -04:00
Brandon Thomas
758314093b
logout endpoint and "test"
2021-05-17 23:36:57 -04:00
Brandon Thomas
80966cd876
reuse session creation
2021-05-17 22:48:49 -04:00
Brandon Thomas
aa740db35b
more "test" scripts
2021-05-17 22:09:01 -04:00
Brandon Thomas
245ef66969
working login
2021-05-17 22:08:48 -04:00
Brandon Thomas
0c9751bea5
test scripts in lieu of actual testing
2021-05-17 20:39:09 -04:00
Brandon Thomas
53c1ed5381
ignore diesel codegen
2021-05-17 20:33:08 -04:00
Brandon Thomas
9893737a57
hmac jwts
2021-05-17 20:31:55 -04:00
Brandon Thomas
d2a75a29ec
pw validations, session expiry +1 year, etc
2021-05-17 16:41:53 -04:00
Brandon Thomas
5076536e6d
username validations
2021-05-17 16:00:32 -04:00
Brandon Thomas
215df96f03
ip address, duplicate record handling
2021-05-17 15:45:24 -04:00
Brandon Thomas
03eee526a0
signup wip; db writes
2021-05-17 02:28:25 -04:00
Brandon Thomas
47ead0febf
random tokens
2021-05-17 02:00:31 -04:00
Brandon Thomas
d0a5959e3c
wip
2021-05-17 00:03:45 -04:00
Brandon Thomas
e93a390a07
different shape
2021-05-16 21:44:07 -04:00
Brandon Thomas
d4a4c1bc96
more example code
2021-05-16 21:12:19 -04:00
Brandon Thomas
2559b73550
singluar endpoint
2021-05-16 20:37:57 -04:00
Brandon Thomas
cb3aa648e5
modules for model queries
2021-05-16 12:15:44 -04:00
Brandon Thomas
2ad5328c98
this inserts into the database!
2021-05-16 12:07:30 -04:00
Brandon Thomas
32a9949559
this version of actix/sqlx works, but uses diff runtime?
2021-05-16 11:57:29 -04:00
Brandon Thomas
0cc74fe266
This configuration works for Actix + Sqlx (older Sqlx)
2021-05-16 11:45:54 -04:00
Brandon Thomas
7d33ecd1df
indices, etc
2021-05-16 10:50:24 -04:00
Brandon Thomas
938f6d15fa
widen tokens
2021-05-16 10:35:54 -04:00
Brandon Thomas
63a63fa28d
widen ip address columns
2021-05-16 10:16:48 -04:00
Brandon Thomas
d1b7fef17c
inference results
2021-05-15 18:01:32 -04:00
Brandon Thomas
6edbec3cb8
inference jobs
2021-05-15 17:46:40 -04:00
Brandon Thomas
b6abf17096
rename migration
2021-05-15 17:32:21 -04:00
Brandon Thomas
3e80c8eba3
more types of tables
2021-05-15 17:31:34 -04:00
Brandon Thomas
72e9c17d50
social media profiles
2021-05-15 17:27:14 -04:00
Brandon Thomas
cb505f1cb0
pk/fk/index defs
2021-05-15 17:22:17 -04:00
Brandon Thomas
7514f162ca
change primary key definitions
2021-05-15 17:01:21 -04:00
Brandon Thomas
783c61d1b4
correct collations
2021-05-15 16:54:51 -04:00
Brandon Thomas
b8d256d137
update readme
2021-05-15 16:45:47 -04:00
Brandon Thomas
9b8f0ce028
all migrations run
2021-05-15 16:43:38 -04:00
Brandon Thomas
a733a2da0b
voices table
2021-05-15 05:04:05 -04:00
Brandon Thomas
ea2261c07a
more schema
2021-05-15 04:48:41 -04:00
Brandon Thomas
5a94e18779
more schema work
2021-05-15 04:29:07 -04:00
Brandon Thomas
b2cf2dc3eb
model asset tables
2021-05-15 03:50:27 -04:00
Brandon Thomas
322895c050
Migrations WIP
2021-05-15 03:45:23 -04:00
Brandon Thomas
2cd8f28757
Actix setup, ServerState arc
2021-05-14 18:12:31 -04:00
Brandon Thomas
9ee55b6a48
gitignore
2021-05-12 11:37:03 -04:00
Brandon Thomas
bb94918905
storyteller-web "monolith", base dependencies
2021-05-12 11:36:19 -04:00
Brandon Thomas
57f1dc5822
add dockerfile + GHA
2021-05-12 04:36:34 -04:00
Brandon Thomas
a3ccf1cc58
switch to env-based config
2021-05-12 04:34:32 -04:00
Brandon Thomas
033c6026ad
switch to env-based config
2021-05-12 03:31:40 -04:00
Brandon Thomas
c14f8bddd5
new dockerfile, GHA, minor updates
2021-05-12 03:17:28 -04:00
Brandon Thomas
19ca3e6671
Redis TLS optional
2021-05-12 02:44:21 -04:00
Brandon Thomas
e22cd83b15
dotenv, easyenv update, template for .env
2021-05-12 01:26:41 -04:00
Brandon Thomas
ac7d4db4a3
switch to env-based config
2021-05-12 00:58:55 -04:00
Brandon Thomas
fc05752ce1
logging
2021-05-12 00:19:36 -04:00
Brandon Thomas
bbd758391b
cleanup, comments
2021-05-11 02:38:57 -04:00
Brandon Thomas
ee7d92256d
notes
2021-05-11 02:36:05 -04:00
Brandon Thomas
ff28b4d00e
change permissions
2021-05-11 02:30:49 -04:00
Brandon Thomas
cdf331cf08
login & pull
2021-05-11 02:24:09 -04:00
Brandon Thomas
dd8ddaf070
change actor
2021-05-11 02:23:15 -04:00
Brandon Thomas
2b00bfbf83
try pulling
2021-05-11 02:19:22 -04:00
Brandon Thomas
59040ca240
testing another login method
2021-05-11 02:17:17 -04:00
Brandon Thomas
4a81758f79
login first before docker build
2021-05-11 02:00:40 -04:00
Brandon Thomas
d483d3cc2c
use base image
2021-05-11 01:57:06 -04:00
Brandon Thomas
752fd73a64
Add metadata to container
2021-05-11 00:43:06 -04:00
Brandon Thomas
92231f7ace
add permissions to step
2021-05-11 00:33:16 -04:00
Brandon Thomas
f559ac395e
not sure this is any different...
2021-05-11 00:32:06 -04:00
Brandon Thomas
79bb1d3614
change image name, use GITHUB_TOKEN
2021-05-11 00:11:32 -04:00
Brandon Thomas
3ca18afceb
GITHUB_TOKEN instead of dangerous PAT
2021-05-10 23:49:06 -04:00
Brandon Thomas
7a3e98bd6b
add dockerfile / build config
2021-05-10 23:29:17 -04:00
Brandon Thomas
ceaf7390c0
rename
2021-05-10 23:23:04 -04:00
Brandon Thomas
5a3faa9fb3
fix dockerfile bug, rename image
2021-05-10 23:21:23 -04:00
Brandon Thomas
91f0134283
rename app
2021-05-10 23:11:44 -04:00
Brandon Thomas
9021499f46
rename app
2021-05-10 23:11:09 -04:00
Brandon Thomas
dcb66a52d5
add dockerfile
2021-05-10 22:18:28 -04:00
Brandon Thomas
4e2c18bece
this builds; unsure if correct
2021-05-10 18:56:52 -04:00
Brandon Thomas
8bd0f22ff7
this builds, but isn't correct
2021-05-10 18:51:57 -04:00
Brandon Thomas
ebd98a3571
fixed type issues
2021-05-10 11:31:31 -04:00
Brandon Thomas
67b750d956
Don't use Twitter user_id just yet due to signedness
2021-05-10 04:10:11 -04:00
Brandon Thomas
921435d177
more twitter fields
2021-05-10 03:51:02 -04:00
Brandon Thomas
134ff704bf
Add protos submodule
2021-05-10 03:13:19 -04:00
Brandon Thomas
021213205a
cleanup
2021-05-10 02:54:27 -04:00
Brandon Thomas
5c8a1730f2
these are the fields we'll use...
2021-05-10 02:51:46 -04:00
Brandon Thomas
7b9e122eb0
self-managing twitter client
2021-05-10 02:16:57 -04:00
Brandon Thomas
2787fa7d67
more data
2021-05-09 22:59:36 -04:00
Brandon Thomas
14d99b44b7
mention example
2021-05-09 15:12:06 -04:00
Brandon Thomas
59c71a82d4
This works!
2021-05-09 15:00:39 -04:00
Brandon Thomas
3d920f9791
get_ccess_token works!
2021-05-09 14:38:53 -04:00
Brandon Thomas
cc20bee727
WIP, work on Twitter secrets
2021-05-09 14:21:14 -04:00
Brandon Thomas
ac78cb3f75
Adapting example from egg crate + twitch-firehose (WIP)
2021-05-09 01:56:16 -04:00
Brandon Thomas
ec35ad5f66
init repo
2021-05-09 00:01:42 -04:00
Brandon Thomas
acaa135d0a
TTS handler
2021-05-08 20:58:42 -04:00
Brandon Thomas
0adc41052b
minor cleanup
2021-05-08 20:38:57 -04:00
Brandon Thomas
15f5d1ae49
cleanup, reuse functions
2021-05-08 20:38:42 -04:00
Brandon Thomas
8611273a89
spawn command handler
2021-05-08 13:12:05 -04:00
Brandon Thomas
c61a069a6f
fix proto field types
2021-05-08 04:18:05 -04:00
Brandon Thomas
0c4221be9f
use redis client with retry for publishing
2021-05-08 03:55:34 -04:00
Brandon Thomas
69f2e2164e
move clients to module
2021-05-08 03:49:10 -04:00
Brandon Thomas
876b149331
check in codegen'd protos
2021-05-08 03:44:19 -04:00
Brandon Thomas
aeb547fa9c
log a few things
2021-05-08 03:39:20 -04:00
Brandon Thomas
8318f615e8
Refactor and reorganization of clients, msg handling, etc
2021-05-08 00:20:49 -04:00
Brandon Thomas
8d5d0702e6
change error handling
2021-05-08 00:06:21 -04:00
Brandon Thomas
5e92b34ee6
Add codegen protos to source, makes easier to brouse in IJ
2021-05-07 23:16:48 -04:00
Brandon Thomas
4bf20681fd
better retry handling
2021-05-07 22:58:15 -04:00
Brandon Thomas
31de77cfd1
cleanup
2021-05-07 22:33:47 -04:00
Brandon Thomas
71758aef4e
use redis connection manager (theoretically reconnects)
2021-05-07 22:12:51 -04:00
Brandon Thomas
d5a329469e
fix wiring
2021-05-07 03:26:57 -04:00
Brandon Thomas
2c907b224b
wire up to outbound proto
2021-05-07 03:22:49 -04:00
Brandon Thomas
e96a29ed6c
updated architecture
2021-05-07 03:03:22 -04:00
Brandon Thomas
8641289f43
add other proto type
2021-05-07 02:20:37 -04:00
Brandon Thomas
7a4f6fbbbf
new enum type
2021-05-07 02:15:21 -04:00
Brandon Thomas
0ae823be44
more proto handling
2021-05-07 00:52:36 -04:00
Brandon Thomas
512829cb09
parse message types (wip)
2021-05-07 00:36:38 -04:00
Brandon Thomas
b69f1c2a76
command parser tests pass
2021-05-06 23:59:47 -04:00
Brandon Thomas
bd0d29973c
add command parser and tests (wip)
2021-05-06 23:51:14 -04:00
Brandon Thomas
aa7e3612f3
WIP on pubsub enricher port to better protos
2021-05-03 23:53:08 -04:00
Brandon Thomas
faf4d85ac6
fix name collision
2021-05-02 19:00:14 -04:00
Brandon Thomas
c620cf5b18
publish to 'firehose' by default
2021-05-02 18:52:13 -04:00
Brandon Thomas
b5663347a2
Major refactor: new payload wrapper type
2021-05-02 18:15:35 -04:00
Brandon Thomas
a1e931b5e8
optional types
2021-05-02 17:31:38 -04:00
Brandon Thomas
491b51939b
omitted payload data
2021-05-02 17:23:49 -04:00
Brandon Thomas
367b1bbc9f
huge refactor to ingestion protos
2021-05-02 17:21:26 -04:00
Brandon Thomas
0775b0f13f
not necessary anymore
2021-05-02 16:31:44 -04:00
Brandon Thomas
3217f96e6f
fix duplication
2021-05-02 16:10:39 -04:00
Brandon Thomas
bf5f427a61
fix protos for C++
2021-05-02 16:08:02 -04:00
Brandon Thomas
590dc6756b
vastly more protos for the unreal firehose
2021-05-02 16:05:52 -04:00
Brandon Thomas
419349d429
send a debug message in the proto
2021-05-01 16:11:10 -04:00
Brandon Thomas
211239cc30
more debug messages
2021-05-01 16:09:22 -04:00
Brandon Thomas
e86757d405
add debug message to payload
2021-05-01 16:08:59 -04:00
Brandon Thomas
de7f23ff99
fix sending (wasn't connected)
2021-05-01 02:42:04 -04:00
Brandon Thomas
43c3d7c3b4
proto2 -> proto3 (UGH INTERFACE), sending fails(?)
2021-05-01 02:38:36 -04:00
Brandon Thomas
f24ccba760
force proto3, protoc 3.6 compatible
2021-05-01 01:52:38 -04:00
Brandon Thomas
5798722724
end-to-end works
2021-04-29 20:48:32 -04:00
Brandon Thomas
6ee9e7ffdf
encode payload in sub-field
2021-04-29 20:38:22 -04:00
Brandon Thomas
2b70ce61e6
build unreal proto
2021-04-29 20:34:22 -04:00
Brandon Thomas
2fcb93f60a
add package to unreal protos
2021-04-29 20:11:50 -04:00
Brandon Thomas
f3451c4a7b
work on geocode handler (I accidentally blew away this commit)
2021-04-29 20:09:47 -04:00
Brandon Thomas
108f080920
add unreal engine protos
2021-04-29 20:04:52 -04:00
Brandon Thomas
d1fb144e99
clean up lat/long parsing
2021-04-29 02:06:08 -04:00
Brandon Thomas
879fce4ef1
more tests passing
2021-04-29 02:01:53 -04:00
Brandon Thomas
39e2b74499
more passing tests
2021-04-29 01:58:46 -04:00
Brandon Thomas
75e1416383
passing test cases
2021-04-29 01:51:57 -04:00
Brandon Thomas
8ec6b8e485
parsing (but test fails)
2021-04-29 01:29:33 -04:00
Brandon Thomas
28e8f4e67c
fixed dispatching, prototype handler
2021-04-29 00:49:16 -04:00
Brandon Thomas
1780c6c0cf
dynamic handler map
2021-04-29 00:22:43 -04:00
Brandon Thomas
982a4ea0f6
wip dispatcher
2021-04-28 23:23:05 -04:00
Brandon Thomas
c0538a2a50
use logger
2021-04-28 23:22:51 -04:00
Brandon Thomas
697942b137
use logger
2021-04-28 23:11:40 -04:00
Brandon Thomas
ef937d8097
break out redis pubsub, add google geocoder crate
2021-04-28 04:49:23 -04:00
Brandon Thomas
88960124fd
gitignore vim
2021-04-28 04:27:17 -04:00
Brandon Thomas
9de4d37273
gitignore vim
2021-04-28 04:26:58 -04:00
Brandon Thomas
39ba0a633c
ingestion and proto decode works! now to build stuff!
2021-04-27 05:47:30 -04:00
Brandon Thomas
e53a72492c
pubsub-enricher: initial commit / app skeleton
2021-04-27 05:03:25 -04:00
Brandon Thomas
848eaa29fe
doc about protos
2021-04-27 04:25:40 -04:00
Brandon Thomas
18861117a4
rename 'twitch-firehose'
2021-04-27 04:24:30 -04:00
Brandon Thomas
a892253577
publish fuller proto
2021-04-27 03:22:55 -04:00
Brandon Thomas
a3051ded47
comment
2021-04-27 03:17:23 -04:00
Brandon Thomas
c31d1934c2
update protos
2021-04-27 03:12:59 -04:00
Brandon Thomas
e5abaf2abf
add new fields to twitchmessage (renumbered the tags)
2021-04-27 03:11:52 -04:00
Brandon Thomas
77b8887b7a
Publish proto to Redis pubsub
2021-04-27 03:06:35 -04:00
Brandon Thomas
1a871b4a74
minor refactor
2021-04-27 01:57:41 -04:00
Brandon Thomas
f369daf567
add storyteller protos git submodule
2021-04-26 03:17:29 -04:00
Brandon Thomas
df54611572
add prost and build script, but no protos yet
2021-04-26 03:13:50 -04:00
Brandon Thomas
67e10dfe3c
rename main
2021-04-26 03:01:22 -04:00
Brandon Thomas
2c8fb4be96
Initial commit; a few messages to bootstrap with
2021-04-26 02:42:35 -04:00
Brandon Thomas
e8a94803b1
add hacky internal rate limiting (just sleep at 503)
2021-04-09 02:48:52 -04:00
Brandon Thomas
f3998347ca
more log instrumentation
2021-04-09 01:24:18 -04:00
Brandon Thomas
05e24f8efc
add a bunch of debug lines to POST /speak
2021-04-09 01:15:35 -04:00
Brandon Thomas
314fe59f33
image with curl
2021-04-09 00:25:43 -04:00
Brandon Thomas
e273999f5d
rename file
2021-04-07 12:40:57 -04:00
Brandon Thomas
9fde197164
remote unnecessary urls; dynamic urls should work now
2021-04-05 03:42:38 -04:00
Brandon Thomas
4278e70442
this works for hosting static files
2021-04-05 03:39:53 -04:00
Brandon Thomas
21422053be
dynamic URLs almost working - JS/CSS assets won't load
2021-04-05 03:17:15 -04:00
Brandon Thomas
2586d39f5f
Infer early access API endpoint from URL
2021-04-05 02:04:30 -04:00
Brandon Thomas
82a47f5d27
JSON early access endpoint
2021-04-05 01:44:04 -04:00
Brandon Thomas
767d7a78e8
use easyenv, more work on "bonus voices" (WIP)
2021-04-05 01:18:22 -04:00
Brandon Thomas
4489225e74
new early acccess rewards system (WIP)
2021-04-04 23:57:21 -04:00
Brandon Thomas
4d820c82cc
fix voice name
2021-04-04 21:07:37 -04:00
Brandon Thomas
b6f0571836
new voices; configurable hidden access URL
2021-04-02 21:13:27 -04:00
Brandon Thomas
0e0cd92f57
move some of the 0mq stuff
2021-03-17 20:47:12 -04:00
Brandon Thomas
76a74a027e
rename module
2021-03-17 20:42:05 -04:00
Brandon Thomas
e460b0e407
fix env vars
2021-03-17 10:20:30 -04:00
Brandon Thomas
fdb074b171
This seems to protect both sets of hidden endpoints
2021-03-17 10:00:15 -04:00
Brandon Thomas
faa75eae82
greatly improved
2021-03-17 09:51:11 -04:00
Brandon Thomas
f4193046e5
getting closer to done
2021-03-17 09:09:33 -04:00
Brandon Thomas
19099545cb
update speaker works
2021-03-17 08:00:45 -04:00
Brandon Thomas
226b36edb5
more cleanup, shared components
2021-03-17 07:52:51 -04:00
Brandon Thomas
f77560a5c6
Add mode switching buttons
2021-03-17 06:07:32 -04:00
Brandon Thomas
ebd04c82a0
Port old frontend (not quite working)
2021-03-17 05:55:21 -04:00
Brandon Thomas
37ea12dbdb
tts_service: multiple hosted dirs, begin work on twitch/patreon
2021-03-17 05:22:06 -04:00
Brandon Thomas
5e1c015e59
add twitch create-react-app
2021-03-17 04:18:27 -04:00
Brandon Thomas
b693d31240
creating a variety of frontends now
2021-03-17 04:06:23 -04:00
Brandon Thomas
d53a262a6d
MJ, Tails, Knuckles
2021-03-17 04:03:42 -04:00
Brandon Thomas
a679908f31
swap the endpoints (quick hack for now)
2021-03-16 21:20:14 -04:00
Brandon Thomas
417b6d599c
never committed!?!
2021-03-16 20:38:31 -04:00
Brandon Thomas
cab31062e2
committing just in case
2021-03-16 20:37:24 -04:00
Brandon Thomas
5c1b0687ab
attempting to do multi-page builds (hack)
2021-03-16 20:35:49 -04:00
Brandon Thomas
e300d7d198
early access speakers JSON endpoint + config
2021-03-16 20:07:18 -04:00
Brandon Thomas
040270422e
add goku config
2021-03-15 21:27:59 -04:00
Brandon Thomas
c969c4e9e3
redis error handling ??
2021-03-09 20:20:06 -05:00
Brandon Thomas
399b7f671e
add debug axes
2021-03-09 06:19:13 -05:00
Brandon Thomas
575003107f
redis publishing from last night
2021-03-09 01:25:26 -05:00
Brandon Thomas
1be8f77b60
cleanup and add username to protocol
2021-03-08 05:21:43 -05:00
Brandon Thomas
c25b016b0d
more abstraction, cleanup
2021-03-08 04:54:18 -05:00
Brandon Thomas
1d43a86364
this should be much better and have recoverability
2021-03-08 03:54:07 -05:00
Brandon Thomas
1e461100e4
in the middle of refactoring
2021-03-08 03:42:59 -05:00
Brandon Thomas
bc34817905
Move all to main
2021-03-08 03:15:35 -05:00
Brandon Thomas
6b250b81eb
refactor secrets
2021-03-08 02:57:44 -05:00
Brandon Thomas
303b3aae74
uncommitted changes
2021-03-08 02:41:42 -05:00
Brandon Thomas
9405aca666
peter griffin and eric cartman
2021-03-07 23:28:13 -05:00
Brandon Thomas
df3b72d460
don't use truncated sensor size
2021-03-02 00:57:32 -05:00
Brandon Thomas
856d2145cf
almost there with the redis client...
...
Thanks random Chinese blog
https://ask.csdn.net/questions/1964104
2021-02-25 05:16:24 -05:00
Brandon Thomas
173446ccce
Twitch chat integration works
2021-02-25 04:08:15 -05:00
Brandon Thomas
cdd2cd1ac4
about to explore 'twitchchat' crate, but too tired to continue
2021-02-24 04:20:44 -05:00
Brandon Thomas
617359c52e
This works to query the API
2021-02-24 03:57:30 -05:00
Brandon Thomas
1812d313a2
read secrets
2021-02-24 00:04:55 -05:00
Brandon Thomas
53268a3d14
First commit, nothing really here except for a lib I did DD on
2021-02-22 23:52:34 -05:00
Brandon Thomas
2f704d0795
Fix windows builds flakiness with build script to copy k4a.lib
2021-02-11 01:17:28 -05:00
Brandon Thomas
79b41f4c3b
remove a lot of unused deps
2021-02-11 00:11:17 -05:00
Brandon Thomas
72bc0e4e7a
move old code into _deprecated for close reference (delete later)
2021-02-10 23:52:25 -05:00
Brandon Thomas
0fb360192d
Fix NaN behavior. This is for you, Juno <3
2021-02-10 23:41:01 -05:00
Brandon Thomas
b129273914
left and right cull
2021-02-04 04:44:01 -05:00
Brandon Thomas
144723a120
xyz offsets
2021-02-04 02:50:33 -05:00
Brandon Thomas
1914a8fb78
fix fps/fov
2021-02-04 02:40:43 -05:00
Brandon Thomas
bddbca639c
cli
2021-02-04 02:37:02 -05:00
Brandon Thomas
5a436a2d43
cleanup
2021-02-04 02:24:35 -05:00
Brandon Thomas
6f850a988e
updated with log messages
2021-02-04 02:00:35 -05:00
Brandon Thomas
8c6f5861a5
minor cleanup
2021-02-04 01:41:14 -05:00
Brandon Thomas
bd18ed9c09
this is probably the config to go with for awhile for cam+depth
2021-02-03 03:29:06 -05:00
Brandon Thomas
bbb0f91112
fix color
2021-02-03 03:01:04 -05:00
Brandon Thomas
40f0e76419
CAMERA COLOR POINT CLOUDS WORK!
2021-02-03 02:56:54 -05:00
Brandon Thomas
d9b07cfabe
Camera transform works (maybe!)
2021-02-03 02:12:26 -05:00
Brandon Thomas
e5d33744bf
add dimension check for point cloud calculation
2021-02-03 02:00:34 -05:00
Brandon Thomas
259b7f60e3
comments on resolutions
2021-02-03 01:52:59 -05:00
Brandon Thomas
aaad3f64a5
functionality restored, but need to figure out dims/transform
2021-02-03 01:41:53 -05:00
Brandon Thomas
52f7de91aa
WIP color camera support (currently slow and wrong dimensions)
2021-02-03 01:28:10 -05:00
Brandon Thomas
1168f94874
move color randomization functions
2021-02-02 22:49:56 -05:00
Brandon Thomas
31532633bf
debugging, starting to pull commands into another module (not done)
2021-02-02 05:37:07 -05:00
Brandon Thomas
a352e9450f
cleanup and debugging (not capping "packets" occasionally segfaults C++)
2021-02-02 04:25:30 -05:00
Brandon Thomas
193fd8d3d6
refactor debug routines, add time-based color
2021-02-02 03:56:46 -05:00
Brandon Thomas
2b8bdf69df
more colors
2021-02-02 03:28:37 -05:00
Brandon Thomas
9ce8f1837c
changed color from f32 to u8 (also in C++), now it works
2021-02-02 03:06:55 -05:00
Brandon Thomas
94aa24c797
update readme
2021-02-01 22:57:07 -05:00
Brandon Thomas
71df3f80fa
rename binary, add debugging
2021-01-31 23:31:19 -05:00
Brandon Thomas
dc9e00f7c2
This created a NewObject, attached component, registred. It works!
...
(Still flickery)
2021-01-21 03:27:23 -05:00
Brandon Thomas
26dcada19d
woooo
2021-01-19 05:27:42 -05:00
Brandon Thomas
a88debe52d
here we go!! far from perfect, but clearly depth
2021-01-19 05:10:45 -05:00
Brandon Thomas
e0373ce0bb
this streams, but we need to modify the protocol
2021-01-19 04:47:47 -05:00
Brandon Thomas
ff6a14f4d7
This seems to read points!!
2021-01-19 04:10:29 -05:00
Brandon Thomas
82caaff720
wip
2021-01-19 04:04:08 -05:00
Brandon Thomas
eaabd0ff09
update program to hypothetically send data length then data
2021-01-19 02:03:32 -05:00
Brandon Thomas
463d7b3b70
update k4a-sys-temp and kinect.rs for windows
2021-01-19 01:09:37 -05:00
Brandon Thomas
896b7fb7b9
add zeromq code from another project
2021-01-18 21:56:27 -05:00
Brandon Thomas
d5e5981475
add color.rs/point.rs from zeromq project
2021-01-18 21:52:44 -05:00
Brandon Thomas
f972b0d657
point cloud calculation! (haven't proven this yet)
2021-01-18 13:50:38 -05:00
Brandon Thomas
c7e749a124
depth xy-table
2021-01-18 01:23:34 -05:00
Brandon Thomas
f8716c5c3e
multiple binaries
2021-01-17 23:57:54 -05:00
Brandon Thomas
23d10028ce
remove other files that won't be used
2021-01-17 23:37:45 -05:00
Brandon Thomas
d36f9e7141
remove old vendored k4a libs
2021-01-17 23:32:50 -05:00
Brandon Thomas
eaaeb47831
Remove 3d object assets; program now runs again
2021-01-17 23:05:30 -05:00
Brandon Thomas
3b9ce4ff35
update to use k4a-sys-temp and kinect.rs
2021-01-17 20:46:05 -05:00
Brandon Thomas
c70053bd44
update readme (k4aviewer works on my laptop now!)
2021-01-16 01:15:24 -05:00
Brandon Thomas
841e57c306
more instruction
2021-01-16 00:48:32 -05:00
Brandon Thomas
37eee321e5
set to use one camera, add Grub instructions
2021-01-16 00:25:32 -05:00
Brandon Thomas
0cd71d1626
remove opencv, update docs for install on Ubuntu 18.04
2021-01-16 00:18:42 -05:00
Brandon Thomas
51284cc6dd
fork old experiments to slim down to just camera -> cloud
2021-01-15 23:54:59 -05:00
Brandon Thomas
1f576b8766
clarify
2021-01-10 22:33:58 -05:00
Brandon Thomas
405a9eb1e1
update install instructions for 20.04
2021-01-10 22:22:36 -05:00
Brandon Thomas
98e675da65
Add in patched k4a-sys library, include build instructions
2021-01-10 22:10:39 -05:00
Brandon Thomas
399487433b
update speaker models
2020-10-26 03:13:52 -04:00
Brandon Thomas
6fe54011a7
revert SSL
2020-10-23 23:26:34 -04:00
Brandon Thomas
188c9e4593
put curl into final build image; less hacky (maybe?)
2020-10-23 22:55:59 -04:00
Brandon Thomas
f01e14ba7b
add two new voices
2020-10-23 22:14:47 -04:00
Brandon Thomas
d4822d0f28
Can't call HTTP-only endpoint anymore; add error messages
2020-10-23 22:07:02 -04:00
Brandon Thomas
65117aa5ce
Use FAST FAST FAST arpabet 2.0 crate
2020-10-13 06:58:59 -04:00
Brandon Thomas
d8e38f091f
new models
2020-10-11 02:48:50 -04:00
Brandon Thomas
7d79fcccdc
six new voices (yaml configs)
2020-10-03 01:25:07 -04:00
Brandon Thomas
b25608e843
Ability to force reload of model (frontend + backend)
2020-10-03 00:13:52 -04:00
Brandon Thomas
56f048ebad
now it isn't responding - fix
2020-09-28 08:02:56 -04:00
Brandon Thomas
9e93bbaf0a
Dampen down the responses being generated
2020-09-28 07:32:51 -04:00
Brandon Thomas
7d120dc4c8
default text
2020-09-28 06:16:12 -04:00
Brandon Thomas
1238cd3fc6
github actions
2020-09-28 05:58:35 -04:00
Brandon Thomas
f8ea7759f1
add static asset, more env vars, --release
2020-09-28 05:55:44 -04:00
Brandon Thomas
0685bd640f
This works!
2020-09-28 05:03:49 -04:00
Brandon Thomas
9e7b33940e
Upload media
2020-09-28 04:07:26 -04:00
Brandon Thomas
b8c2ba2b94
location, reply to, and don't tweet back self
2020-09-28 03:57:09 -04:00
Brandon Thomas
5c99d2ce5c
Reducing workers seemed to work; (I was starving them?)
2020-09-28 03:22:08 -04:00
Brandon Thomas
3ddea5bd67
Twitter Bot: tokio and futures are hard. Not yet working
2020-09-28 03:16:35 -04:00
Brandon Thomas
fcb5410663
multiple speakers and help message
2020-09-17 05:27:48 -04:00
Brandon Thomas
4cf253bec0
change order of reconfigure/reload (important)
2020-09-15 23:59:08 -04:00
Brandon Thomas
2d3aac80a7
add browser restart and driver reload scripts
2020-09-15 21:50:59 -04:00
Brandon Thomas
22f7ed7586
add endpoint to report min and max character limits
2020-09-14 02:09:10 -04:00
Brandon Thomas
90d33e70c1
add logging to launch script
2020-09-13 23:49:34 -04:00
Brandon Thomas
e4ee56e0dc
don't build a new response, modify the old one
2020-09-13 07:45:29 -04:00
Brandon Thomas
fa05996e34
clean up response modification
2020-09-13 07:03:01 -04:00
Brandon Thomas
f2b0ec1c46
add proxy hostname to response (but this isn't elegant/safe)
2020-09-13 06:37:24 -04:00
Brandon Thomas
1126803cab
don't create messages on zero-length or non-200
2020-09-12 04:47:41 -04:00
Brandon Thomas
518a716c59
Add dockerfile build
2020-09-12 04:12:58 -04:00
Brandon Thomas
d3d4ba2f66
cleanup
2020-09-12 03:54:27 -04:00
Brandon Thomas
dbb292c0c1
First commit. Basic vocoding bot!
2020-09-12 03:34:53 -04:00
Brandon Thomas
c8d875c95d
per-device calibration handling (no longer distorted)
...
We were only using the primary device's calibration
2020-09-11 11:56:19 -04:00
Brandon Thomas
4a222ad815
realtime-voice-conversion based on last year's work
...
This is based on the work I did in (July - October)ish 2019 to get real
time voice conversion working. I've removed it from the `voder` library
and made it into an isolable program. I'll work on extending the
capabilities.
2020-09-11 09:06:48 -04:00
Brandon Thomas
77ad6a7e08
Broke OPTION / CORS by not matching on method
2020-09-10 05:21:03 -04:00
Brandon Thomas
8977255088
remove nightly-only build error source; remove unused imports
2020-09-10 04:54:29 -04:00
Brandon Thomas
5f02cb0df9
retry rate limit bypass; new speakers
2020-09-10 04:30:32 -04:00
Brandon Thomas
df55d55b84
configurable retry limit and duration
2020-09-10 04:30:11 -04:00
Brandon Thomas
e1c39e65de
Robust proxying with retry
...
Also includes upgraded hyper-reverse-proxy, hyper, and futures.
This is looking and feeling way more ergonomic.
2020-09-10 04:18:08 -04:00
Brandon Thomas
ed43e2af6e
Buffered writer constrained to 1024*8 capacity
2020-09-07 00:06:05 -04:00
Brandon Thomas
08a94bccb7
new voice configurations
2020-09-06 16:38:22 -04:00
Brandon Thomas
74de16f952
if I just read the docs, I would have figured this out sooner :|
2020-09-05 00:46:17 -04:00
Brandon Thomas
625dac6c19
Move speak_proxy forwarding function into module
2020-09-05 00:37:49 -04:00
Brandon Thomas
2d3896af55
Add homer simpson
2020-08-25 22:44:29 -04:00
Brandon Thomas
66e535d96f
instructions on webcam
2020-08-25 02:59:55 -04:00
Brandon Thomas
5cc08d00cc
working configs from ticket in README
2020-08-25 02:49:16 -04:00
Brandon Thomas
aee237d805
install script
2020-08-25 02:05:04 -04:00
Brandon Thomas
d6b5cb5af0
split webcam management scripts
2020-08-25 02:00:33 -04:00
Brandon Thomas
8201760b84
script to reinstall the akvcam webcam (it's super flaky)
2020-08-25 01:43:27 -04:00
Brandon Thomas
26bce07709
add depth threshold to kinect, move cameras
2020-08-25 01:23:09 -04:00
Brandon Thomas
14c36d2745
shader cleanup
2020-08-25 01:09:05 -04:00
Brandon Thomas
543de0f785
TWO CAMERAS WORKING IN OPENGL AND SHADED
2020-08-25 00:57:41 -04:00
Brandon Thomas
978d5b2dfa
cleanup render
2020-08-25 00:38:28 -04:00
Brandon Thomas
38e83beb58
holy shit it works!
2020-08-24 23:50:05 -04:00
Brandon Thomas
342a4dedbd
I think I finally found a way to tell GLSL what to do
2020-08-24 23:36:28 -04:00
Brandon Thomas
b1b55bed7c
better positions and sizes for everything
2020-08-24 22:36:47 -04:00
Brandon Thomas
1333c1f3a1
reorient bridge
2020-08-24 22:29:13 -04:00
Brandon Thomas
9a56ca2b50
no longer rotate level
2020-08-24 22:25:01 -04:00
Brandon Thomas
0a0719be74
discard transparent pixels
2020-08-24 20:05:14 -04:00
Brandon Thomas
2f22131621
kokiri bridge level
2020-08-24 20:02:41 -04:00
Brandon Thomas
7a08b772ca
texture transparency
2020-08-24 19:47:59 -04:00
Brandon Thomas
db492449c2
add n64 zelda poe
2020-08-24 19:45:34 -04:00
Brandon Thomas
5a6a1c2d28
just needed to flip the texture
2020-08-24 18:27:01 -04:00
Brandon Thomas
0d0feadc47
checkerboard test
2020-08-24 18:16:20 -04:00
Brandon Thomas
b36895a81b
move models; add kingo dodongo; add logging
2020-08-24 16:56:31 -04:00
Brandon Thomas
82eeeaacd4
fixing k4a-sys updated some stuff in the background
2020-08-24 16:10:32 -04:00
Brandon Thomas
fbbbbfa677
add pichu model+texture
2020-08-24 04:04:51 -04:00
Brandon Thomas
650e106385
cleanup
2020-08-24 04:03:22 -04:00
Brandon Thomas
93b790fe8e
Textures kind of work...
2020-08-24 02:07:50 -04:00
Brandon Thomas
4c33046f1f
rotate models
2020-08-24 01:03:00 -04:00
Brandon Thomas
7679ca4e5b
flip the objects to face the camera
2020-08-24 00:41:37 -04:00
Brandon Thomas
23038489bb
multiple image texture formats (rgba,rgb)
2020-08-23 13:56:00 -04:00
Brandon Thomas
f1e65c5509
Texture coords! They're broken, but the brokenness looks cool
2020-08-23 13:42:58 -04:00
Brandon Thomas
dbc81c4816
Organize OpenGL MVP matrix stuff a bit
2020-08-23 02:59:54 -04:00
Brandon Thomas
b8addae3e0
Multiple renderable objects
2020-08-23 02:49:09 -04:00
Brandon Thomas
ce7c409259
rotation works (but is messy!)
2020-08-22 05:01:48 -04:00
Brandon Thomas
fb297ecd1b
scaling, cleanup
2020-08-22 04:47:30 -04:00
Brandon Thomas
514fb08ff1
more ergonomic uniform
2020-08-22 04:36:29 -04:00
Brandon Thomas
f461cbf2b9
more typesafe uniforms
2020-08-22 04:33:01 -04:00
Brandon Thomas
b4fbf635d0
model transformation works!
2020-08-22 04:24:25 -04:00
Brandon Thomas
e17a902560
positionable object (transformation mat fails)
2020-08-22 03:47:42 -04:00
Brandon Thomas
62baa3b210
rust2018 edition; work starting on matrix math
2020-08-22 03:02:23 -04:00
Brandon Thomas
70af17ded0
object work, before matrix stack
2020-08-22 02:38:42 -04:00
Brandon Thomas
3f143011a0
break out renderableobject as its own thing
2020-08-20 23:51:25 -04:00
Brandon Thomas
07335a75ff
Render Yoshi model
2020-08-20 03:18:37 -04:00
Brandon Thomas
a435565a04
Introduce obj loader (not yet working)
2020-08-19 13:39:12 -04:00
Brandon Thomas
cdbdf77f15
Lots of cleanup... following graphics4363
2020-08-18 03:19:42 -04:00
Brandon Thomas
f95b76c893
rename to disambiguate
2020-08-18 02:24:25 -04:00
Brandon Thomas
b0ecc38308
split opengl wrapper structs into their own files
2020-08-18 02:22:51 -04:00
Brandon Thomas
24b05ce2c4
lots of changes to binding orders; no progress
2020-08-18 02:11:18 -04:00
Brandon Thomas
5e03a52547
IMPROVEMENT! Now both geos shaded by one color
2020-08-18 01:35:28 -04:00
Brandon Thomas
a3a1825014
just experimenting...
2020-08-16 21:10:03 -04:00
Brandon Thomas
826d419c34
option to save frames
2020-08-16 15:39:25 -04:00
Brandon Thomas
eb1144d197
command line to turn on and off options
2020-08-16 05:11:09 -04:00
Brandon Thomas
762e839a57
No longer need to start cameras!
2020-08-16 04:47:20 -04:00
Brandon Thomas
68d3e4dc39
working intrinsics/extrinsics !
2020-08-16 04:30:24 -04:00
Brandon Thomas
8016a4d24d
wrap k4a calibration
2020-08-16 03:40:34 -04:00
Brandon Thomas
2b7bbe61aa
Fake Capture Proxy Works! + debug tools
2020-08-16 02:52:55 -04:00
Brandon Thomas
bccefd55ed
FakeDeviceCapturer, wrapper additions; new path fails, but old works
2020-08-16 02:25:31 -04:00
Brandon Thomas
9725876300
proxy fully plumbed through
2020-08-16 00:51:52 -04:00
Brandon Thomas
4c0183801a
fix bug with CaptureProxy
2020-08-16 00:31:07 -04:00
Brandon Thomas
274394c235
cleanup CaptureProxy k4a::Capture consumption
2020-08-15 23:46:51 -04:00
Brandon Thomas
d450a82a37
more internal usage
2020-08-15 23:28:06 -04:00
Brandon Thomas
87d4a19aee
more ImageProxy usage
2020-08-15 23:22:17 -04:00
Brandon Thomas
50f5689330
more internal ImageProxy usage
2020-08-15 23:13:26 -04:00
Brandon Thomas
14a480faa1
use ImageProxy more internally
2020-08-15 23:01:26 -04:00
Brandon Thomas
fb78650fbb
rename awkward CameraImageBytes to ImageProxy
2020-08-15 22:54:15 -04:00
Brandon Thomas
67c5c345c2
Further work on wrapping (may not compile, this is half of my changes)
2020-08-15 22:30:27 -04:00
Brandon Thomas
68ea871c9f
move up the stack
2020-08-15 20:35:31 -04:00
Brandon Thomas
04621392d6
completely static depth and color buffers
2020-08-15 19:54:35 -04:00
Brandon Thomas
0d3f67691d
write both color and depth images to file
2020-08-15 19:34:14 -04:00
Brandon Thomas
e33bed276a
extract point cloud compute shader; share file ops
2020-08-15 18:28:25 -04:00
Brandon Thomas
3731462d77
reduce duplication between static and from-camera color images
2020-08-15 17:58:47 -04:00
Brandon Thomas
436cb7fa8a
use static color frame data instead of from camera
2020-08-15 17:34:27 -04:00
Brandon Thomas
20f9f6535c
write color frames to disk
2020-08-15 16:56:59 -04:00
Brandon Thomas
3f3a207040
pull out link_program
2020-08-15 16:16:19 -04:00
Brandon Thomas
793178b8b6
both cameras won't render. ugh
2020-08-15 15:53:58 -04:00
Brandon Thomas
c7f87e2e3d
Read in shaders from files
2020-08-15 15:46:12 -04:00
Brandon Thomas
cf0ee7a543
location seems to be needed in shaders
2020-08-15 15:36:41 -04:00
Brandon Thomas
cad9d76da6
both cameras correctly render INDEPENDENTLY
2020-08-15 15:08:49 -04:00
Brandon Thomas
20a8be8375
much easier to see now...
2020-08-15 01:32:13 -04:00
Brandon Thomas
3319d32256
cycle between two cameras
2020-08-15 01:20:37 -04:00
Brandon Thomas
7352f3f6d2
cleanup; pink was due to missing "layout(location=10)"
2020-08-14 04:01:30 -04:00
Brandon Thomas
adb6f45fd3
the other geo is pink!?!
2020-08-13 21:20:31 -04:00
Brandon Thomas
f367fd1e74
setup before testing
2020-08-13 20:50:22 -04:00
Brandon Thomas
5fcee17554
more comments on debugging (multiple colorings still not working)
2020-08-13 15:43:37 -04:00
Brandon Thomas
5e47aece53
experimental results recorded to comment
2020-08-13 03:32:27 -04:00
Brandon Thomas
f5b8af9d07
interesting bug that textures both cameras, but only from one source
2020-08-13 03:09:25 -04:00
Brandon Thomas
491ea637bd
notes, cleanup
2020-08-13 01:35:03 -04:00
Brandon Thomas
35b08c6f5b
add spongebob
2020-08-12 18:58:26 -04:00
Brandon Thomas
a8c53c0954
add grapheme_to_phoneme for OOV support
2020-08-09 15:41:11 -04:00
Brandon Thomas
2021285227
add new speakers
2020-08-05 05:00:06 -04:00
Brandon Thomas
6c66da2964
add logging to attributes
2020-08-05 01:10:08 -04:00
Brandon Thomas
43599c2a02
add newrelic attribute for speaker
2020-08-05 00:45:56 -04:00
Brandon Thomas
47f4f75eb5
build newrelic libs
2020-08-04 23:36:01 -04:00
Brandon Thomas
6bd56aad75
add newrelic logging capability
2020-08-04 22:26:30 -04:00
Brandon Thomas
6090f56b2c
updatd models from last week
2020-08-02 04:10:54 -04:00
Brandon Thomas
bb98218e55
add to /speak
2020-08-02 03:29:20 -04:00
Brandon Thomas
7058d77889
cleanup of stats recorder
2020-08-02 03:26:12 -04:00
Brandon Thomas
d498aa5d76
cleanup, remove actors
2020-08-02 03:11:24 -04:00
Brandon Thomas
191cdc8158
This works! Async updates
2020-08-02 02:37:10 -04:00
Brandon Thomas
01158a8529
actix background actor works!
2020-08-02 01:03:19 -04:00
Brandon Thomas
1ff11a46fc
This works! 200s from the other microservice
2020-08-02 00:27:45 -04:00
Brandon Thomas
8d28402172
embedded http client - this seems to work!
2020-08-02 00:13:13 -04:00
Brandon Thomas
5f15bba160
tts_frontend: retain text between speaker/spectrogram modes
2020-07-25 22:37:36 -04:00
Brandon Thomas
2eabd03b48
REMOVE DEPRECATED CODE/FILES, SUCH AS VOICE CONVERSION
2020-07-25 22:19:20 -04:00
Brandon Thomas
ad23fe0c80
move project to new 'voice' directory
2020-07-25 21:40:42 -04:00
Brandon Thomas
933a4f4c26
hacky racial slur ban list
2020-07-24 10:58:44 -04:00
Brandon Thomas
e0cafae746
add nine new speakers
2020-07-24 04:46:36 -04:00
Brandon Thomas
6cfd5a54eb
Made database connection optional
2020-07-24 01:30:57 -04:00
Brandon Thomas
174843c7ed
better rate limiter configuration
2020-07-24 00:37:40 -04:00
Brandon Thomas
73935076f8
both speak endpoints speak json errors
2020-07-23 22:08:59 -04:00
Brandon Thomas
b708fa0d1f
share request and error response; turn error responses to json
2020-07-23 22:04:04 -04:00
Brandon Thomas
a1af6c6c5d
bypass rate limit with 'limitless' header
2020-07-23 20:28:38 -04:00
Brandon Thomas
7c71835043
put all TTS endpoints in same module
2020-07-23 20:09:07 -04:00
Brandon Thomas
bb0431fa0f
remove unused deps
2020-07-23 19:51:14 -04:00
Brandon Thomas
471be6b8a9
refactor IP address into common
2020-07-23 19:47:34 -04:00
Brandon Thomas
aabdaac3fd
no-op rate limiter
2020-07-22 13:47:38 -04:00
Brandon Thomas
50fdb15fd2
reasonable blocking rate limiter
2020-07-22 13:27:19 -04:00
Brandon Thomas
58e9f58a49
this appears to work, but something is up with the timeout
2020-07-22 13:11:06 -04:00
Brandon Thomas
312593d897
this captures everything
2020-07-22 12:35:36 -04:00
Brandon Thomas
7087320cdf
wip redis rate limiting
2020-07-22 12:24:52 -04:00
Brandon Thomas
8ee0e50ea1
add a lot of new speakers
2020-07-20 03:49:47 -04:00
Brandon Thomas
c504b1dd33
Add reagan and attenborough
2020-07-11 05:45:25 -04:00
Brandon Thomas
a72aa93ad2
Enable arpabet extensions to extend CMUdict
2020-07-08 17:11:10 -04:00
Brandon Thomas
d844592a65
update speakers to use latest melgan
2020-07-01 23:04:31 -04:00
Brandon Thomas
3efb517b77
use new melgan for speakers
2020-07-01 22:56:06 -04:00
Brandon Thomas
5ad1b1b432
set sample rate for all speakers not using default
2020-07-01 22:41:19 -04:00
Brandon Thomas
ee9a0c1552
Fix pitch issues. Most models need 22050, melgan's default
2020-07-01 22:38:50 -04:00
Brandon Thomas
0877e13cb9
log url for downloading
2020-07-01 21:39:35 -04:00
Brandon Thomas
aeb905357e
this should finally report the correct IP
2020-07-01 06:08:06 -04:00
Brandon Thomas
6aef89c6ef
debug by printing all headers
2020-07-01 05:46:04 -04:00
Brandon Thomas
9730d31a60
Handle custom forwarded IP header, but preserve native IP handling
2020-07-01 05:15:41 -04:00
Brandon Thomas
c7aba90ee9
custom forwarded-for type header
2020-07-01 04:53:43 -04:00
Brandon Thomas
97fbd58bb7
testing the headers; can't find remote IP
2020-07-01 04:17:16 -04:00
Brandon Thomas
4c5d096db7
add debugging for headers: forwarded,x-forwarded-for
2020-07-01 03:43:18 -04:00
Brandon Thomas
4c1be4faef
add latest production models
2020-07-01 03:39:22 -04:00
Brandon Thomas
e7025d035f
confirmed this is correct; no longer need to log
2020-07-01 03:38:16 -04:00
Brandon Thomas
0fda9f97c3
cleanup stale comments, add debug statement for IP
2020-07-01 03:22:57 -04:00
Brandon Thomas
ae060729dc
add proxy healthcheck endpoint
2020-06-30 06:51:35 -04:00
Brandon Thomas
801304adde
bind 0.0.0.0
2020-06-30 06:21:36 -04:00
Brandon Thomas
7e4d5f375d
add debugging to catch-all route
2020-06-30 06:10:20 -04:00
Brandon Thomas
8052f3d5a1
change model keys
2020-06-30 04:13:01 -04:00
Brandon Thomas
d98a41a721
rearrange model file
2020-06-30 04:11:20 -04:00
Brandon Thomas
850401fafa
add dev and prod model paths
2020-06-30 03:56:35 -04:00
Brandon Thomas
b9078063b3
add gilbert gottfried configs
2020-06-30 02:40:06 -04:00
Brandon Thomas
36c1c0f007
greatly simplify model config
2020-06-30 02:21:07 -04:00
Brandon Thomas
7455e51148
populate 'forwarded' header as well
2020-06-30 00:11:42 -04:00
Brandon Thomas
4a5ec4bdba
add proxy config to docker, fix IP x-forwarded-for
2020-06-29 23:56:26 -04:00
Brandon Thomas
b50f84c280
always fall back to default host
2020-06-29 22:59:05 -04:00
Brandon Thomas
e850941f40
Working proxy design
2020-06-29 22:54:05 -04:00
Brandon Thomas
96e900457e
cleanup default routing
2020-06-29 20:12:07 -04:00
Brandon Thomas
8238977553
Copy entire body too, and remove header hack
2020-06-29 20:02:32 -04:00
Brandon Thomas
b268d98b86
cleanup
2020-06-29 19:42:32 -04:00
Brandon Thomas
649623c39f
more efficient header copy
2020-06-29 19:32:57 -04:00
Brandon Thomas
56f707e89b
copy (most) headers
2020-06-29 19:29:16 -04:00
Brandon Thomas
48a3e831ea
refactor proxying (works!)
2020-06-29 18:58:56 -04:00
Brandon Thomas
c89569aa8e
Proxying works!
2020-06-29 15:21:20 -04:00
Brandon Thomas
cd68e43389
cleanup (still need to pass original request)
2020-06-29 14:56:22 -04:00
Brandon Thomas
663284df87
This decodes the request successfully!
2020-06-29 07:07:19 -04:00
Brandon Thomas
0e2990ee2c
This compiles, but isn't logical
2020-06-29 07:03:11 -04:00
Brandon Thomas
09ed0163af
WIP: Futures not working
2020-06-29 06:55:24 -04:00
Brandon Thomas
aa7345be2d
Proxy OPTIONS header
2020-06-29 05:09:22 -04:00
Brandon Thomas
6396b6a690
configure port
2020-06-29 04:24:54 -04:00
Brandon Thomas
f6619e5fef
add proxy_configs.toml (unread currently)
2020-06-29 04:06:28 -04:00
Brandon Thomas
97d9490f2f
deployment for a service-based setup
2020-06-29 03:00:29 -04:00
Brandon Thomas
67d094d38e
screw it, install curl with apt
2020-06-29 02:35:39 -04:00
Brandon Thomas
dce95dea18
all the libs
2020-06-29 02:24:19 -04:00
Brandon Thomas
fc50a06e7f
another curl dep
2020-06-29 02:19:24 -04:00
Brandon Thomas
4e97688e9b
fix libcurl src
2020-06-29 02:08:10 -04:00
Brandon Thomas
461db14259
Add curl in final image
2020-06-29 01:55:43 -04:00
Brandon Thomas
de5a5b0783
Add github workflow and dockerfile
2020-06-29 00:55:15 -04:00
Brandon Thomas
d4853707c7
Testing routing
2020-06-29 00:24:14 -04:00
Brandon Thomas
9ec8010f10
updates to model configs
2020-06-29 00:06:45 -04:00
Brandon Thomas
97e94d9e56
This proxy works!
2020-06-28 23:44:16 -04:00
Brandon Thomas
28fee8eee7
initial commit
2020-06-28 22:23:48 -04:00
Brandon Thomas
ac3d407c35
DB migration: widen the speaker column
2020-06-24 06:37:42 -04:00
Brandon Thomas
60211d6df6
analytic /words endpoint
2020-06-23 02:52:11 -04:00
Brandon Thomas
5bb81303c2
log database insertion errors
2020-06-23 02:23:21 -04:00
Brandon Thomas
3a5b45f5ce
new deployed model; changed size of k8s replicaset
2020-06-23 01:03:56 -04:00
Brandon Thomas
6e76f37552
fixed deployment and deployed models
2020-06-22 05:45:06 -04:00
Brandon Thomas
8004011d29
change model toml files
2020-06-22 05:26:23 -04:00
Brandon Thomas
74d8d1d90c
stupid numerics bug for glow tts
2020-06-22 02:27:50 -04:00
Brandon Thomas
e44198428c
sort headers
2020-06-22 02:16:24 -04:00
Brandon Thomas
afea8746e2
finally compiles
2020-06-22 02:11:46 -04:00
Brandon Thomas
c559fb74ae
moved mountains, but now there's Sized to deal with
2020-06-22 01:53:39 -04:00
Brandon Thomas
6a2748b9b3
pipeline work (doesn't compile)
2020-06-22 00:45:21 -04:00
Brandon Thomas
9e2a63b17d
pipeline integrated into /spectrogram_speak endpoint
2020-06-21 07:38:07 -04:00
Brandon Thomas
01b38aeb99
Add second pipeline
2020-06-21 07:20:48 -04:00
Brandon Thomas
49551168af
pipeline has end-to-end inference in place
2020-06-21 07:14:22 -04:00
Brandon Thomas
80dc4d3853
wip: this should be the pipeline structure
2020-06-21 06:37:37 -04:00
Brandon Thomas
5ec1395b82
WIP almost there... trait objects have lifetime
2020-06-21 06:33:48 -04:00
Brandon Thomas
1c37e79e12
WIP: model pieces into the pipeline
2020-06-21 06:11:19 -04:00
Brandon Thomas
139805c606
WIP: Even closer
2020-06-21 06:04:13 -04:00
Brandon Thomas
c31dea17e5
WIP getting closer
2020-06-21 05:56:51 -04:00
Brandon Thomas
9b3366c70c
WIP: Still setting this pipeline up
2020-06-21 05:52:13 -04:00
Brandon Thomas
9883dc0d53
WIP: Still working on pipeline lifetimes
2020-06-21 05:45:30 -04:00
Brandon Thomas
3353aed5ff
WIP: pipeline system, complex lifetime and box traits
2020-06-21 04:22:25 -04:00
Brandon Thomas
82240cb605
add colormaps from matplotlib
2020-06-19 23:49:37 -04:00
Brandon Thomas
f300f3e61b
flip spectrogram
2020-06-17 03:16:55 -04:00
Brandon Thomas
fee33c4179
beautiful spectrogram
2020-06-17 03:08:31 -04:00
Brandon Thomas
72b0c94971
hacky spectrograms!
2020-06-17 02:32:31 -04:00
Brandon Thomas
f87592bfc3
New endpoint to return base64 spectrogram + audio
2020-06-17 01:35:34 -04:00
Brandon Thomas
a908c43660
voices in multi-voice model
2020-06-15 02:33:41 -04:00
Brandon Thomas
90a15366b3
support for multi-speaker glow-tts models (broken in tensor dims)
2020-06-15 00:33:45 -04:00
Brandon Thomas
42f51ecd18
add vo.codes to CORS allow hosts
2020-06-14 17:25:23 -04:00
Brandon Thomas
0281e206db
second attempt at iphone content-range fix
2020-06-09 19:20:01 -04:00
Brandon Thomas
898e32db05
SHA with iOS headers; but it didn't work
2020-06-08 03:59:17 -04:00
Brandon Thomas
078f2183b1
headers to make iOS Safari work (maybe?)
2020-06-08 03:39:29 -04:00
Brandon Thomas
985e5e3549
min-width is too wide for mobile
2020-06-07 19:11:44 -04:00
Brandon Thomas
478980e64b
per page increase
2020-06-07 19:06:21 -04:00
Brandon Thomas
1272891e9c
sentence table: wider, variable height
2020-06-07 18:54:45 -04:00
Brandon Thomas
93d1d27879
How did I never check this in?! I hate VSCode sometimes
2020-06-07 18:50:40 -04:00
Brandon Thomas
a0f5c1987e
update post /speak endpoint to record to database
2020-06-07 07:03:39 -04:00
Brandon Thomas
5701b816a1
downloader debugging, pod scale experiments
2020-06-05 20:22:39 -04:00
Brandon Thomas
58ec25e3aa
fix env logger
2020-06-05 19:23:27 -04:00
Brandon Thomas
41334b1ee5
add some tests
2020-06-05 19:06:56 -04:00
Brandon Thomas
f060397402
more debugging statements
2020-06-05 18:55:59 -04:00
Brandon Thomas
2975473320
replace tabs (ugh, gross)
2020-06-05 18:45:54 -04:00
Brandon Thomas
65cc9922cd
add warning
2020-06-05 18:44:35 -04:00
Brandon Thomas
b8905d7f48
deployed version with new mumble.stream frontend
2020-06-05 00:32:17 -04:00
Brandon Thomas
b76c294159
comments for cleanup
2020-06-05 00:06:54 -04:00
Brandon Thomas
39270bca4b
working (albeit messy) modal UI with speaker,advanced,sentence modes
2020-06-05 00:03:25 -04:00
Brandon Thomas
0e599b1748
modal UI (WIP, speaker/advanced broken)
2020-06-04 23:58:39 -04:00
Brandon Thomas
e039516954
sentence table component
2020-06-04 23:25:04 -04:00
Brandon Thomas
c5db0e4734
sentences API: pagination direction
2020-06-04 23:24:21 -04:00
Brandon Thomas
b0009596bf
playable table data
2020-06-04 22:54:40 -04:00
Brandon Thomas
9568b8333b
sentence endpoint is paginated now
2020-06-04 22:34:59 -04:00
Brandon Thomas
e0d10496c3
new CORS localhost ports, new CORS headers
2020-06-04 20:35:17 -04:00
Brandon Thomas
2fc7d23fb9
new memory limit seems to support larget sentences,
2020-06-04 19:24:02 -04:00
Brandon Thomas
a90f4b669a
add hostname to response
2020-06-04 19:12:04 -04:00
Brandon Thomas
dc5ec801bf
updated models
2020-06-04 19:03:27 -04:00
Brandon Thomas
abd1772c65
the new model; also changed request/limits
2020-06-04 13:56:42 -04:00
Brandon Thomas
6fd42e529c
Ugh, this works. This is growing hard to configure
2020-06-04 03:51:34 -04:00
Brandon Thomas
7c2aeca5d2
fix
2020-06-04 03:12:56 -04:00
Brandon Thomas
6f6101fa77
Arpabet scheme works
2020-06-04 01:10:14 -04:00
Brandon Thomas
96a5ee4dab
This _almost_ works. I need to encode straight to i64
2020-06-04 00:35:57 -04:00
Brandon Thomas
a6af26b4df
holy shit that worked
2020-06-03 20:06:20 -04:00
Brandon Thomas
9922e5a913
GlowTTS; almost working - forward() needs multiple args
2020-06-03 00:59:58 -04:00
Brandon Thomas
acd0203177
move model configs under model/
2020-06-03 00:05:14 -04:00
Brandon Thomas
2bafa7cec0
sort sentences desc, increase limit to 1000
2020-06-01 02:19:06 -04:00
Brandon Thomas
66bf126639
new melgan added! it sounds awesome
2020-06-01 01:48:14 -04:00
Brandon Thomas
6e0767bb9d
min/max character length
2020-06-01 01:45:16 -04:00
Brandon Thomas
a671a66b39
begin work on text cleaners
2020-05-31 22:39:47 -04:00
Brandon Thomas
0ce7baaa0b
new IP address scheme
2020-05-31 22:11:26 -04:00
Brandon Thomas
306f78b762
deployment with working database
2020-05-31 22:03:49 -04:00
Brandon Thomas
d83cd11aaf
This should fix all the linker errors
2020-05-31 21:42:18 -04:00
Brandon Thomas
ea184a452c
fix dockerfile ?
2020-05-31 21:07:47 -04:00
Brandon Thomas
bf55a77079
Copy mysqlclient libs
2020-05-31 20:53:35 -04:00
Brandon Thomas
7de69b8cbd
dockerfile needs libmysqlclient-dev
2020-05-31 20:24:54 -04:00
Brandon Thomas
488a9739f9
cleanup internal env vars
2020-05-31 20:11:19 -04:00
Brandon Thomas
2e622de648
make db configurable
2020-05-31 20:08:19 -04:00
Brandon Thomas
83a4bb919d
rust warnings cleanup
2020-05-31 20:04:33 -04:00
Brandon Thomas
a862124dc5
LIMIT on sentences query
2020-05-31 19:49:50 -04:00
Brandon Thomas
2cc5ea67ba
Endpoint to serve sentences as JSON
2020-05-31 19:39:03 -04:00
Brandon Thomas
3c1bc0b1a8
include speaker
2020-05-31 18:27:19 -04:00
Brandon Thomas
bf68ebba34
Added database and ability to record sentences
2020-05-31 18:03:44 -04:00
Brandon Thomas
17091b4b44
deployment: set num workers and downloader sleep
2020-05-31 01:43:05 -04:00
Brandon Thomas
243d16b7f1
add mumble.stream to CORS allow
2020-05-31 01:40:11 -04:00
Brandon Thomas
d61138cd10
add log line
2020-05-31 01:09:34 -04:00
Brandon Thomas
7e81c76c82
add sleep parameter and comment about hash inequality
2020-05-31 01:05:57 -04:00
Brandon Thomas
64419fa64e
add secrets config
2020-05-31 00:48:42 -04:00
Brandon Thomas
62754920cb
guranteed QoS for deployment
2020-05-31 00:45:12 -04:00
Brandon Thomas
4317bab01a
num workers arg, refactor arg parsing
2020-05-31 00:30:20 -04:00
Brandon Thomas
565519867d
Fix hash comparison, more logging
2020-05-30 22:57:18 -04:00
Brandon Thomas
e87eed7b8a
Add more logging
2020-05-30 22:29:23 -04:00
Brandon Thomas
68ae78516d
deployment: downloader that acts as a job
2020-05-30 22:09:15 -04:00
Brandon Thomas
bf957be07b
add more logging to model loading
2020-05-30 21:42:15 -04:00
Brandon Thomas
c8eeb91a20
Make further use of logger
2020-05-30 21:28:38 -04:00
Brandon Thomas
51e182708d
change error message to distinguish
2020-05-30 20:40:40 -04:00
Brandon Thomas
9a1e7b52e0
Add launch file
2020-05-30 20:33:56 -04:00
Brandon Thomas
906f0b4b67
Deployment with do_spaces_downloader
2020-05-30 20:09:05 -04:00
Brandon Thomas
40349c08da
Include SSL certs with build
2020-05-30 19:24:27 -04:00
Brandon Thomas
7a27c2eff3
docker build
2020-05-30 16:25:01 -04:00
Brandon Thomas
a9313b0ff0
Initial version
2020-05-30 15:22:01 -04:00
Brandon Thomas
5a7886520a
prevent segfaulting by serializing tacotron access
...
uses a non-blocking mutex acquire, with up to 500 milliseconds of retry
2020-05-29 01:42:39 -04:00
Brandon Thomas
44465a9c76
bump actix workers, move old_model, run segfault experiment
2020-05-29 01:23:30 -04:00
Brandon Thomas
81a96f73c8
better error messages
2020-05-28 23:16:51 -04:00
Brandon Thomas
c7672af5cd
defaults for required env vars; webserver index.html
2020-05-28 22:42:51 -04:00
Brandon Thomas
25220a1309
comments
2020-05-28 03:44:44 -04:00
Brandon Thomas
bbb6487b98
this deployment works and turns off logspam
2020-05-27 23:54:34 -04:00
Brandon Thomas
7452be9b1c
This change to deployment.yaml results in 3 healthy nodes
2020-05-27 23:48:26 -04:00
Brandon Thomas
b496e0b0b0
no liveness probe, tweaked readiness probe
2020-05-27 22:01:52 -04:00
Brandon Thomas
efb054d2f7
Better tts error handling (but needs logging)
2020-05-27 22:01:34 -04:00
Brandon Thomas
573aa9f4ca
cleanup pods in all namespaces except loki/graphana
2020-05-27 21:38:00 -04:00
Brandon Thomas
b4dd56b65c
Add hostname to logs
2020-05-27 20:35:52 -04:00
Brandon Thomas
31689ec97e
no longer log tensors
2020-05-27 20:27:13 -04:00
Brandon Thomas
2984c1786b
Fix legacy API to require speaker and text
...
Early out if not present
2020-05-27 20:15:04 -04:00
Brandon Thomas
2dcc4e5896
no longer log /liveness and /readiness (logspam)
2020-05-27 20:08:37 -04:00
Brandon Thomas
fd91d303b2
deployment: stop s3fs logging for graphana
2020-05-27 19:49:16 -04:00
Brandon Thomas
9cd7e56651
Pod cleanup script (ugh, this is gross)
2020-05-27 18:48:53 -04:00
Brandon Thomas
4eb1b3e79b
increase replicas to 5, wrap in launch script
2020-05-27 15:10:54 -04:00
Brandon Thomas
7e4d663f73
Add launch script to manage in-container restarts
2020-05-27 14:49:10 -04:00
Brandon Thomas
9e092eee4a
updated deployed_models.yaml
2020-05-27 04:29:22 -04:00
Brandon Thomas
d584527187
deployed models yaml
2020-05-27 04:26:08 -04:00
Brandon Thomas
6b89620b3c
Add endpoint to handle legacy GET requests from the old frontend
2020-05-27 04:11:21 -04:00
Brandon Thomas
9003eb5c16
better errors
2020-05-27 01:46:01 -04:00
Brandon Thomas
694d869cd4
Update frontend to work in different (autodetected) envs
2020-05-27 01:41:03 -04:00
Brandon Thomas
9fedbcd967
refactor frontend into directories by mode
2020-05-27 00:23:13 -04:00
Brandon Thomas
3ce772cd80
Modal test frontend can hit /speak or /advanced_tts
2020-05-27 00:17:10 -04:00
Brandon Thomas
ac1a9281d4
CORS, logger
2020-05-26 22:46:22 -04:00
Brandon Thomas
d4b1fa93b1
Add CORS allow list
2020-05-26 22:21:09 -04:00
Brandon Thomas
450c4ebe0a
Add /speak and /speakers endpoints
2020-05-26 20:57:40 -04:00
Brandon Thomas
0652199e8a
ignore models and wav files
2020-05-26 20:37:55 -04:00
Brandon Thomas
a20a7259b5
beef up module config: shared base dir, speakers
2020-05-26 20:36:08 -04:00
Brandon Thomas
805bad97c3
server code cleanup, cache model configs
2020-05-26 06:15:59 -04:00
Brandon Thomas
729bdefdbc
Updated deployment
2020-05-26 05:37:25 -04:00
Brandon Thomas
dafe174dc3
Repair dockerfile: needs libtorch 1.5; update symlinks
2020-05-26 02:52:05 -04:00
Brandon Thomas
d3a0a30884
tts_service: specify model config file by env var
2020-05-26 01:15:58 -04:00
Brandon Thomas
0a70b326e7
Kind of stuck, now. Rendering red and blue point clouds
...
- Color information from second camera only gets through if first camera
is disabled.
- How do I print BOTH point clouds from uniform data?
2020-05-18 04:47:45 -04:00
Brandon Thomas
6141c453fd
two point clouds translated on the x-axis
2020-05-18 01:07:33 -04:00
Brandon Thomas
d7d52485d7
two point clouds! (gl_VertexID-interleaved rendering)
2020-05-18 01:01:15 -04:00
Brandon Thomas
983d301554
getting somewhere, but this is confusing.
...
Changing textures in the point_cloud_renderer GLSL to be either index 0
or 1 (pointCloudTexture0 or pointCloudTexture1, each corresponding to a
camera) to the opposite of the skip block in the loop on line 611 will
show a perfect shaded image from the non-skipped camera.
This suggests that both cameras are sending texture and color data.
However...
Trying to do a linear combination from non-skipped color data is WEIRD
though, and not as I'd expect.
2020-05-18 00:47:55 -04:00
Brandon Thomas
56b4271295
Something interesting going on.
...
- Both inputs are some combination of colors
- Covering one camera leads to a black image
- Covering another camera leads to a red-shaded image
One of the cameras must not be wired up correctly.
2020-05-18 00:11:09 -04:00
Brandon Thomas
cfb4f8d6dd
Handle multi-cam vertex array object buffer for color (doesn't work yet)
...
The code works to load multiple VAOs and buffers, but the camera data
isn't properly segregated yet. Need to figure out what to bind
2020-05-17 23:10:50 -04:00
Brandon Thomas
ce64b80fed
upgrade tch.rs 0.1.3 -> 0.1.7 (still segfaults)
2020-05-17 19:47:54 -04:00
Brandon Thomas
ad0ca149f8
I *think* this works now. See binding=0,1 in GLSL
...
Note: we're currently looking at pointCloudTexture1, which is a
different depth camera from the color data
2020-05-17 05:55:58 -04:00
Brandon Thomas
ed74711f80
switch between camera for point cloud renders
2020-05-17 04:10:29 -04:00
Brandon Thomas
a882e89b1c
show both converted depth xyz textures!
2020-05-17 03:59:25 -04:00
Brandon Thomas
83d7534b26
Visualizer now switches between multiple cameras (one at a time)
2020-05-17 03:37:34 -04:00
Brandon Thomas
99a9a2f966
Incremental support for multiple cameras: PointCloudVisualizer
...
Lots of internal use of Vec<T>, but still tied to 0-indexed items
Code quality --
Still compiles and runs
2020-05-17 03:06:42 -04:00
Brandon Thomas
d09aab5743
Incremental support for multiple cameras: Multiple PointCloudConverter
...
Code quality --
Suport ++
2020-05-17 02:40:57 -04:00
Brandon Thomas
83cee2c4f2
make more readable by sending basenames to frontend
2020-05-15 03:00:49 -04:00
Brandon Thomas
9772cabd99
Model picker! Updated frontend and backend
...
This allows the frontend user to choose which melgan and tacotron are
used at runtime without restarting the server. It could use UI
improvement, but it works.
The available models are configured with a toml config file loaded by
the backend.
2020-05-15 01:20:52 -04:00
Brandon Thomas
f5cf28a589
upgrade sentence.rs
2020-05-11 02:21:28 -04:00
Brandon Thomas
b3432795e5
Better space insertion, handling of punctuation
2020-05-11 00:30:10 -04:00
Brandon Thomas
6139bc6b3d
Add sentence/numerics.rs for tokenization, numbers
2020-05-10 22:55:15 -04:00
Brandon Thomas
7b2eff1387
uncommitted changes to frontend
2020-05-10 22:42:07 -04:00
Brandon Thomas
8625daa59d
Add frontend index.html
2020-05-10 22:39:00 -04:00
Brandon Thomas
d2f517b092
doc commit
2020-05-06 20:58:38 -04:00
Brandon Thomas
33bf87a1e4
uncommitted changes
2020-05-06 20:58:05 -04:00
Brandon Thomas
d18efaaefc
make enabling webcam easier
2020-05-05 05:15:12 -04:00
Brandon Thomas
83954a0742
update so we don't have to specify secondary devices
2020-05-05 05:12:31 -04:00
Brandon Thomas
c83bf467c0
synchronized capture! (still only reading one image)
2020-05-04 05:38:41 -04:00
Brandon Thomas
5bb60032c3
multi-device capturer (starts multiple cameras in order)
2020-05-04 04:44:38 -04:00
Brandon Thomas
9081a3da26
refactor: organize kinect and opengl modules
2020-05-04 03:28:41 -04:00
Brandon Thomas
a4d16224c2
refactor (move arcball to gui code)
2020-05-04 02:10:56 -04:00
Brandon Thomas
2a0cb25a8f
no more SDL arcball for now
2020-05-04 02:07:02 -04:00
Brandon Thomas
a06afdde38
handle zoom only within imgui window
2020-05-04 02:05:11 -04:00
Brandon Thomas
c2c9dbceed
animation hacks
2020-05-03 22:22:33 -04:00
Brandon Thomas
52338b9bcb
animation
2020-05-01 07:25:05 -04:00
Brandon Thomas
95fec69018
stupid experimentally determined camera zero :(
2020-05-01 07:13:37 -04:00
Brandon Thomas
67a10b0892
custom perspective matrix based on k4a
2020-05-01 06:07:32 -04:00
Brandon Thomas
991f1b8aaa
clear color, rgbaf32 type
2020-05-01 05:16:33 -04:00
Brandon Thomas
ba5366d65e
clean up some unused imports
2020-05-01 04:53:29 -04:00
Brandon Thomas
65f1d5b980
ran cargo fix and then CLion import optimizer
2020-05-01 04:40:21 -04:00
Brandon Thomas
21d40a9fe9
about to run cargo fix
2020-05-01 04:28:54 -04:00
Brandon Thomas
790e0a9748
move old code (preserved since I'm still new to this)
2020-05-01 04:25:40 -04:00
Brandon Thomas
0ffa97f9af
new arcball abstraction to clean up code
2020-05-01 04:21:45 -04:00
Brandon Thomas
22a48dba60
arcball implementation (a bit rough around the edges)
2020-05-01 03:07:45 -04:00
Brandon Thomas
e2671e4380
much more efficient and cleaned up WebcamWriter
2020-04-30 21:40:10 -04:00
Brandon Thomas
e29d003973
akvcam config pared down to sensible configs
2020-04-30 05:07:53 -04:00
Brandon Thomas
2c6e205ac5
check in akvcam configs
2020-04-30 04:53:19 -04:00
Brandon Thomas
0ae6682518
THIS WORKS. WEBCAM OUT WORKS
2020-04-30 03:14:54 -04:00
Brandon Thomas
1721d1b3da
width and height GRADIENT rendering are perfect
2020-04-30 03:07:26 -04:00
Brandon Thomas
b581e9cd36
lets me share a webcam view, but horrible and distorts texture
2020-04-29 23:34:43 -04:00
Brandon Thomas
02eb6ec94a
this has output, but it's hidden. only the very top shows
2020-04-29 05:20:15 -04:00
Brandon Thomas
38d3258a44
I can stream to the virtual device /dev/video7!
2020-04-29 03:28:02 -04:00
Brandon Thomas
50255bef04
small refactor, different clearcolor
2020-04-28 03:19:02 -04:00
Brandon Thomas
cc1f822f5c
add distance threshold and scaling
2020-04-28 03:08:25 -04:00
Brandon Thomas
6685e41e14
IT WORKS !! ! ! ! ! ! !! !!@!21
2020-04-27 05:10:56 -04:00
Brandon Thomas
299390f9b4
restored shaders
2020-04-27 04:47:26 -04:00
Brandon Thomas
4f8279bc9e
cleanup (note - I pared down the existing shader, so I should revert)
2020-04-27 04:40:48 -04:00
Brandon Thomas
4f3e5f0e5c
implementation of simple/color shading (perfect!)
2020-04-26 21:28:16 -04:00
Brandon Thomas
c591d0d6c1
FIXED! Ugh. RG32F, not RGB32F
2020-04-26 19:27:25 -04:00
Brandon Thomas
27c5f32e80
debugging xy depth table
2020-04-26 18:47:59 -04:00
Brandon Thomas
87fbf45ed9
cleanup
2020-04-26 17:29:40 -04:00
Brandon Thomas
73ef98251e
much closer, but still have to finish the last piece
2020-04-26 05:34:28 -04:00
Brandon Thomas
0bbbe2f9c2
point cloud colorization isn't it...
2020-04-26 04:14:45 -04:00
Brandon Thomas
2225c1c962
removing alpha from compute shader -- now the texture exists!!!
2020-04-26 04:10:49 -04:00
Brandon Thomas
242aa53b7d
now we can set xyz texture to all white in the shader
2020-04-26 04:07:25 -04:00
Brandon Thomas
ba56591226
fix issue with pixel iteration order
2020-04-26 01:19:07 -04:00
Brandon Thomas
2ee94842af
handle debug bgra32 images
2020-04-26 00:52:06 -04:00
Brandon Thomas
db4585fa5c
pixel image debugging
2020-04-26 00:46:22 -04:00
Brandon Thomas
504e28240a
need to impl depth pixel colorizer
2020-04-26 00:20:25 -04:00
Brandon Thomas
ab2f4c33ae
new image debug routine
2020-04-25 23:59:42 -04:00
Brandon Thomas
553afd801d
display output in quadrants
2020-04-25 18:01:40 -04:00
Brandon Thomas
4aee7995c5
nice cleanup to surface all intermediate textures
2020-04-25 17:46:22 -04:00
Brandon Thomas
a9e1af8c7f
light refactor - rename classes
2020-04-25 17:31:07 -04:00
Brandon Thomas
54063f2553
improve xy_table generation (still not fixed)
...
The visual output is a vertical line with camera input colorization
2020-04-25 17:19:49 -04:00
Brandon Thomas
966bb66b53
a line of color with the correct matrix!
2020-04-24 03:32:51 -04:00
Brandon Thomas
5b11bca593
projection and view matrices (no effect?!)
2020-04-22 04:42:00 -04:00
Brandon Thomas
eadafd34ab
That pixel is real geometry. About to mess w/ projection matrix
2020-04-22 04:16:29 -04:00
Brandon Thomas
4dab692e2d
THAT PIXEL IS NOW ANIMATED!?!#@?
2020-04-22 03:58:05 -04:00
Brandon Thomas
ef2770a50b
clean up comments
2020-04-22 03:40:29 -04:00
Brandon Thomas
b0fab79970
small fixes, still no video
2020-04-22 03:19:28 -04:00
Brandon Thomas
7b450769bc
resized window
2020-04-22 01:19:01 -04:00
Brandon Thomas
d52d7d9b8e
something is drawing on top of the texture!
2020-04-22 01:04:35 -04:00
Brandon Thomas
8e5f526c2c
reorganize - opengl module, rebinder struct
2020-04-22 00:54:41 -04:00
Brandon Thomas
0de5a9bb38
render image *and* frame (but still not visible)
2020-04-22 00:24:55 -04:00
Brandon Thomas
a1dc4e124c
shows the texture in an opengl-backed imgui renderer!
2020-04-22 00:15:40 -04:00
Brandon Thomas
3998022aa0
load custom texture, but can't render it
2020-04-21 23:53:13 -04:00
Brandon Thomas
bf2f1ee35f
Everything reenabled, imgui still renders!!
2020-04-20 04:14:25 -04:00
Brandon Thomas
7436f088da
with viz, this "supposedly" reverses everything (but doesn't)
2020-04-20 03:26:43 -04:00
Brandon Thomas
820715bd40
Holy shit, rebinding the texture worked on visualizer!
...
I was listening to some old Golden Sun music and it crscendoed
right as the demo worked.
https://www.youtube.com/watch?v=A6Z4QoUsd_8
After a week of no visuals, now I'm running some of this code with
visual output.
2020-04-20 03:00:48 -04:00
Brandon Thomas
bfe2e16a40
BY BINDING THE OLD TEXTURE, WE RESTORE IMGUI
2020-04-20 02:57:38 -04:00
Brandon Thomas
730bf8b3ce
extract opengl debugging
2020-04-20 02:35:00 -04:00
Brandon Thomas
2f56db8c06
had to load gl function ptrs (gl::load_with(...))
2020-04-20 02:12:47 -04:00
Brandon Thomas
7618577e5e
add imgui-rs (downgrade glium and glutin)
2020-04-20 01:59:51 -04:00
Brandon Thomas
c1ff0273ee
zero out memory
2020-04-20 01:08:29 -04:00
Brandon Thomas
0cd7c0c454
capture refcounts
2020-04-19 06:48:12 -04:00
Brandon Thomas
c65d0c9b64
fix xy_table init 'valid' bit, lots of debug statements...
2020-04-19 06:02:49 -04:00
Brandon Thomas
2df1ba36cc
better k4a image refcount handling, lots of logging, ...
2020-04-19 05:04:52 -04:00
Brandon Thomas
71e1de69ad
no longer double freeing captures
2020-04-19 02:47:02 -04:00
Brandon Thomas
e7acd39320
wasn't binding the shader program (still not fixed)
2020-04-19 01:18:06 -04:00
Brandon Thomas
0dbb9888d3
more debugging; added glDebug callback
2020-04-19 01:15:53 -04:00
Brandon Thomas
ce30f437c2
introduced rng as point cloud output
2020-04-18 23:38:37 -04:00
Brandon Thomas
8a466882c4
wrong byte divisor
2020-04-18 23:25:18 -04:00
Brandon Thomas
e62ff78730
this runs for awhile before crashing (still no point cloud)
2020-04-18 23:22:48 -04:00
Brandon Thomas
e192369bb8
Runs. Old webcam input had to be removed. Still can't update texture
2020-04-18 22:57:34 -04:00
Brandon Thomas
fae1d4001c
no segfaults
2020-04-18 22:35:31 -04:00
Brandon Thomas
726e8ccc56
this runs (old code paths), commented out new stuff.
...
let's iterate from here...
2020-04-18 22:20:25 -04:00
Brandon Thomas
5f6237d03e
This segfaults at runtime, but I think pieces are in place
2020-04-18 20:04:14 -04:00
Brandon Thomas
a111e8653a
viewer image
2020-04-18 18:54:05 -04:00
Brandon Thomas
2962a29b3f
cleanup guard, update texture
2020-04-18 17:28:11 -04:00
Brandon Thomas
4dd75420d6
partially done with visualizer update_point_clouds
2020-04-18 17:11:07 -04:00
Brandon Thomas
d3592431e7
set_colorization_strategy
2020-04-18 06:44:35 -04:00
Brandon Thomas
78da717595
visualizer, ctor, update_texture, wip/untested
2020-04-18 05:39:49 -04:00
Brandon Thomas
6aa57fb712
error handling
2020-04-18 01:45:10 -04:00
Brandon Thomas
4ba7827677
add error enum
2020-04-17 23:23:37 -04:00
Brandon Thomas
9b08c5b16f
render() untested
2020-04-17 04:04:30 -04:00
Brandon Thomas
07ab055aca
renderer - update_point_clouds function (untested)
2020-04-17 03:56:22 -04:00
Brandon Thomas
7512e06240
starting work on the rendering shader, everything compiles but untested
2020-04-17 02:44:12 -04:00
Brandon Thomas
72e326702a
memory copy piece (don't know if it works)
2020-04-17 01:21:00 -04:00
Brandon Thomas
9c162d472a
uniform binding
2020-04-17 00:38:33 -04:00
Brandon Thomas
2e6597048b
2d to 3d was impl'd in the library!
2020-04-17 00:17:37 -04:00
Brandon Thomas
e94b9c44dd
attempt at writing array of struct memory... (untested)
2020-04-16 05:40:43 -04:00
Brandon Thomas
7d19979b1d
k4a image constructor
2020-04-16 05:08:20 -04:00
Brandon Thomas
1db741dc12
set_active_xy_table impl, not tested
2020-04-16 03:50:09 -04:00
Brandon Thomas
d50f91fa19
convert
2020-04-16 03:40:33 -04:00
Brandon Thomas
bacb2072ef
sort these
2020-04-16 03:31:00 -04:00
Brandon Thomas
88c447d35a
replace raw opengl with wrappers in a few places
2020-04-16 03:26:48 -04:00
Brandon Thomas
4a3bd917c6
opengl wrapper for convenience
2020-04-16 02:49:41 -04:00
Brandon Thomas
69820d00bd
move unused graphics libs to module to remove later
2020-04-16 02:08:54 -04:00
Brandon Thomas
3a56e9e0e2
point cloud code builds, but isn't correct yet
2020-04-16 01:59:06 -04:00
Brandon Thomas
6c9740d86c
working on point cloud shader (wip)
2020-04-15 04:06:43 -04:00
Brandon Thomas
2f6484bf82
create a compute shader from the k4a libs
2020-04-14 03:34:26 -04:00
Brandon Thomas
52fbe25154
streaming color camera
2020-04-13 05:09:08 -04:00
Brandon Thomas
65d397c5f1
now it's streaming!
2020-04-13 04:50:58 -04:00
Brandon Thomas
ebb4bcaf3d
texture was actually easy, it's just not redrawing without input
2020-04-13 04:44:45 -04:00
Brandon Thomas
5bd3f95bfa
stringly typed binding. UGH. fixed
2020-04-13 04:27:08 -04:00
Brandon Thomas
5c57a0aaa1
wip (not working)
2020-04-13 00:06:39 -04:00
Brandon Thomas
2a6378a687
texture setup ... but is it working?
2020-04-12 23:31:28 -04:00
Brandon Thomas
93d2110419
square via ebo!
2020-04-12 23:02:48 -04:00
Brandon Thomas
a56fe7b6b6
now drawing with element array buffers!
2020-04-12 22:59:33 -04:00
Brandon Thomas
fdc395ae54
helper functions for stride and offset
2020-04-12 22:29:35 -04:00
Brandon Thomas
1f21bb17d6
got attribute pointers for stride!
2020-04-12 22:22:39 -04:00
Brandon Thomas
9470d037d7
color uniform
2020-04-12 22:10:12 -04:00
Brandon Thomas
d7cc98b1ab
try to line this up with open.gl tutorial
2020-04-12 22:04:18 -04:00
Brandon Thomas
3ec973d123
cleanup
2020-04-12 21:31:56 -04:00
Brandon Thomas
0a62edafec
now trying a mix of gl, glium, glfw
2020-04-12 21:20:52 -04:00
Brandon Thomas
910b68617b
unpack from captureprovider
2020-04-12 20:44:27 -04:00
Brandon Thomas
5905830343
I don't like 'unsafe impl Send' :( :( :(
2020-04-11 03:46:27 -04:00
Brandon Thomas
220763d47f
move the handwritten k4a wrappers out of the way
2020-04-11 02:41:21 -04:00
Brandon Thomas
fce6e0f86f
swapped glium for grr (no longer streaming frames!)
2020-04-11 02:24:49 -04:00
Brandon Thomas
e681eeff76
move glium stuff, going to try grr
2020-04-11 02:13:47 -04:00
Brandon Thomas
4fc0363a62
small refactor, comment
2020-04-11 01:41:37 -04:00
Brandon Thomas
0107483c82
minor cleanup
2020-04-06 01:54:31 -04:00
Brandon Thomas
b807346714
offload processing onto acquisition thread (needs cleanup!)
2020-04-06 01:49:51 -04:00
Brandon Thomas
58c72b24c3
smaller critical section, but didn't fix lag
2020-04-05 22:46:19 -04:00
Brandon Thomas
3ce5d4d871
optimize imports
2020-04-05 22:24:29 -04:00
Brandon Thomas
5c6f5b019d
streams image, but grossly suboptimal (<<1 FPS)
2020-04-05 22:21:38 -04:00
Brandon Thomas
22fc554ea1
cleanup
2020-04-05 21:52:19 -04:00
Brandon Thomas
3c59597309
I got a kinect frame into OpenGL!
2020-04-05 03:52:59 -04:00
Brandon Thomas
ae4dd1f536
image loads, but is probably wrong byte depth
2020-04-05 03:48:33 -04:00
Brandon Thomas
783b92aaed
compiles, but fails at runtime for wrong image format
2020-04-05 03:27:55 -04:00
Brandon Thomas
8364d000f5
Switch textures in OpenGL/Glium
2020-04-05 02:36:42 -04:00
Brandon Thomas
1ed32ff356
display depth image
2020-04-04 04:19:37 -04:00
Brandon Thomas
ed811d031c
read images from the sensor
2020-04-04 04:14:32 -04:00
Brandon Thomas
19dbab3a05
obtain capture
2020-04-04 03:48:44 -04:00
Brandon Thomas
40aa93c46b
Now we can start and stop the cameras
2020-04-04 03:33:42 -04:00
Brandon Thomas
f859b9dd74
start writing wrappers for k4a-sys
2020-04-03 23:16:09 -04:00
Brandon Thomas
04f3c36201
Lo! A new library appears on the horizon: k4a-sys
2020-04-03 00:51:21 -04:00
Brandon Thomas
f1351dbf49
and even the segfaults went away
2020-03-28 05:47:42 -04:00
Brandon Thomas
99bc74cb73
Over time, the pointers started to look right
2020-03-28 05:34:38 -04:00
Brandon Thomas
0f37d06b99
Properly "000513594512" without a NUL terminal.
2020-03-28 04:45:52 -04:00
Brandon Thomas
bb6a0e6692
And that's how we discovered 000513594512 (extra byte)
2020-03-28 04:40:44 -04:00
Brandon Thomas
2ed9758cbb
And it told us serial size: 13.
2020-03-28 04:34:55 -04:00
Brandon Thomas
babcdb10d3
The answer was correct pointer use!
2020-03-28 04:07:05 -04:00
Brandon Thomas
4a24ea8b11
but it was hard to read from and close them.
2020-03-28 03:59:02 -04:00
Brandon Thomas
63e850e824
and we found we could open devices
...
(But not close them)
2020-03-28 03:13:13 -04:00
Brandon Thomas
96615927cd
At first we could call libk4a
...
(And this actually does work! I tried!)
```
hello world
Device count: 1
```
2020-03-28 02:32:13 -04:00
Brandon Thomas
cf8580dce9
Once upon a time
2020-03-28 01:51:32 -04:00
Brandon Thomas
f7b6c3582f
deploying new trumped arpabet engine to DigitalOcean k8s
2020-02-06 12:24:41 -05:00
Brandon Thomas
6e766720ca
UI improvements
2020-01-19 02:54:55 -05:00
Brandon Thomas
b1777f74ce
better style
2020-01-19 02:31:43 -05:00
Brandon Thomas
42bded9656
better frontend with history (messy, though)
2020-01-18 02:59:27 -05:00
Brandon Thomas
96a146c5e1
Arpabet processing in Tacotron
2020-01-16 03:17:50 -05:00
Brandon Thomas
9570339569
fix asset frontend and directory
2020-01-11 01:00:39 -05:00
Brandon Thomas
6b5c225676
Frontend works; added static serving to server
2020-01-10 11:42:19 -05:00
Brandon Thomas
47f12cbb94
Frontend now plays audio
2020-01-10 02:34:50 -05:00
Brandon Thomas
cad84328c4
Frontend skeleton that can post to backend
2020-01-09 03:48:07 -05:00
Brandon Thomas
8ac98c973a
npx create-react-app tts_frontend
...
--template=typescript
This is just the boilerplate
2020-01-08 18:56:56 -05:00
Brandon Thomas
841c644d57
Dockerfile for release build
2020-01-07 01:21:54 -05:00
Brandon Thomas
d25f9a6a17
Shared S3 (digitalocean space) volume
2020-01-07 01:18:41 -05:00
Brandon Thomas
ea761a76b9
improved deployment w liveness + readiness probes
2020-01-06 19:33:12 -05:00
Brandon Thomas
374e1a477d
Server with Torch + Libtorch; Model load via env
2020-01-06 18:18:39 -05:00
Brandon Thomas
da29a1f403
This deployment works, finally
2020-01-06 04:48:07 -05:00
Brandon Thomas
a8858f2375
argument for address binding
2020-01-06 04:24:53 -05:00
Brandon Thomas
539570e079
k8s deployment, change network interface binding
2020-01-06 03:06:05 -05:00
Brandon Thomas
d5f4d229ff
move workflow (why didn't wysiwyg create here?)
2020-01-06 00:44:30 -05:00
Brandon Thomas
601fcb525d
YAML config for github action to publish to GPR
2020-01-06 00:43:19 -05:00
Brandon Thomas
de4cf5c174
Docker container. Breaks tacotron_melgan (haven't ported to actix)
2020-01-06 00:18:33 -05:00
Brandon Thomas
9f73582091
Adding skeleton of deployable service
2020-01-05 05:47:09 -05:00
Brandon Thomas
6fdbaa2ad1
this works
2020-01-05 03:29:17 -05:00
Brandon Thomas
91dea21a2f
This works!!
2020-01-04 05:15:30 -05:00
Brandon Thomas
914631c72c
It works! Wrong output sample rate - 20000
2020-01-04 05:11:51 -05:00
Brandon Thomas
edd521f2fd
exact audio tensor match with python tacotron-melgan (wav audio still off)
2020-01-04 05:02:17 -05:00
Brandon Thomas
9baea196d8
(not working, wip)
2020-01-04 04:33:47 -05:00
Brandon Thomas
25de25e3b0
Everything necessary to do scripting instead of tracing
2020-01-03 02:47:34 -05:00
Brandon Thomas
ad694e77a4
Change JIT mel tensor to float (from double). Works.
2020-01-03 02:35:44 -05:00
Brandon Thomas
ee5e48eae5
wip loading mels
2020-01-03 00:59:21 -05:00
Brandon Thomas
89e414225f
Fixes to get this working with JIT scripting (vs tracing)
2020-01-02 04:45:09 -05:00
Brandon Thomas
1ca7ee8a5b
rename models
2020-01-02 01:19:49 -05:00
Brandon Thomas
c0cac635f4
Add README to tacotron_melgan
2019-12-31 04:33:53 -05:00
Brandon Thomas
465a6f87f2
unsqueeze - still not working
2019-12-30 06:34:19 -05:00
Brandon Thomas
1f9235d56e
added text input, but it fails currently
2019-12-30 06:27:35 -05:00
Brandon Thomas
56e553ae66
Serving over Rocket HTTP works (very inelegant ATM)
2019-12-30 05:59:27 -05:00
Brandon Thomas
6c4d97e860
minor cleanup
2019-12-30 04:45:10 -05:00
Brandon Thomas
f51a7cd621
This works end-to-end
2019-12-30 04:15:34 -05:00
Brandon Thomas
89d08a449e
Rust Tacotron2 model runs, albeit SLOWLY
2019-12-30 03:48:24 -05:00
Brandon Thomas
4079ec379c
Tacotron model JIT works?
2019-12-30 03:41:57 -05:00
Brandon Thomas
3aacd5412e
add sequence file
2019-12-30 03:13:28 -05:00
Brandon Thomas
c986184fbf
This may have done it! (Python 3.6 upgrade helped)
2019-12-30 01:32:01 -05:00
Brandon Thomas
6985075187
This compiles but is garbage
...
- I removed Tacotron2.forward
2019-12-29 02:50:19 -05:00
Brandon Thomas
c86eeea550
minor progress, Tacotron JIT still does not work
2019-12-27 03:13:47 -05:00
Brandon Thomas
03cd0dc0db
model jit wrapping: got rid of postnet (wip)
2019-12-27 03:04:49 -05:00
Brandon Thomas
e492e2e10c
Added hparams and chopped off a few model pieces. Doesn't work yet
2019-12-27 02:46:05 -05:00
Brandon Thomas
2c33358db7
add nvidia's tacotron2 model
2019-12-27 02:31:30 -05:00
Brandon Thomas
546e5d7a09
Adding Tacotron2 wrapper (WIP)
2019-12-27 02:29:09 -05:00
Brandon Thomas
6982e65e0c
rename script
2019-12-27 00:24:18 -05:00
Brandon Thomas
c2b03c461a
seems pretty fast
2019-12-26 06:49:03 -05:00
Brandon Thomas
f051ab76a0
Now there's human voice audio!!!! WOO!
2019-12-26 06:44:40 -05:00
Brandon Thomas
57cbe02d7d
rename the model nodes
2019-12-26 06:33:42 -05:00
Brandon Thomas
60763c5120
I think this fixes the ResBlock
2019-12-26 06:01:00 -05:00
Brandon Thomas
3de3a3770c
add random sampling
2019-12-26 05:10:08 -05:00
Brandon Thomas
f07a628469
this makes clicking noises, but still mostly zero
2019-12-26 05:02:57 -05:00
Brandon Thomas
55947770cd
Model outputs audio, but all zeroes right now
2019-12-26 03:39:16 -05:00
Brandon Thomas
346855955c
Useful hacky script for jit containerizing mels/tensors
...
This seems to be the only(?) way of loading single tensors into
libtorch/tch.rs. It's a hack: load the tensor, pack it into a container
module, then define a forward method that returns the wrapped tensor.
2019-12-26 02:02:25 -05:00
Brandon Thomas
b9efb9db60
This might be a new approach...
2019-12-26 01:21:41 -05:00
Brandon Thomas
99d13ed283
light refactor
2019-12-25 17:01:28 -05:00
Brandon Thomas
615595c0d3
Add some mels for testing
2019-12-25 16:49:01 -05:00
Brandon Thomas
194c220ad2
Move melgan scripts to sub-project
2019-12-25 16:32:43 -05:00
Brandon Thomas
282e05340f
Now the two Tacotron projects work with the Rust Workspace
2019-12-25 01:54:02 -05:00
Brandon Thomas
a03966c209
Refactor into "workspace" project. VC sidecar works again!
...
Tensorflow Tacotron and Torch Tacotron+Melgan are broken (the latter
hasn't worked yet anyhow)
2019-12-25 01:31:19 -05:00
Brandon Thomas
56ba5fbaaa
wip (I need to restructure this entire codebase)
2019-12-25 00:05:57 -05:00
Brandon Thomas
da9ffb03bf
closer match py JIT output; can load/eval from rust
2019-12-23 16:40:45 -05:00
Brandon Thomas
5d0d22c5f8
Adds the ability to load PyTorch models (read more)
...
- Python script de-cudas the models and exports them in the
understandable "zip" format. (The models output by MelGan, Tacotron, etc
do not conform to something Rust's libtorch bindings can understand by
default)
- Adds the Rust code to load but not the cargo deps since that needs a
refactor. The version is `tch = "0.1.3"`
2019-12-23 15:01:39 -05:00
Brandon Thomas
b77de37029
Merge branch 'master' of github.com:echelon/voder
2019-12-16 01:33:15 -05:00
Brandon Thomas
01896b7f9a
crop image, add lots of comments
2019-12-14 04:06:45 -05:00
Brandon Thomas
3bf8f3a044
this looks much closer to a spectrogram
2019-12-14 03:28:08 -05:00
Brandon Thomas
4408fd664e
image visualization (WIP)
2019-12-14 03:24:23 -05:00
Brandon Thomas
ed1f63c9a3
Pow_1 looks like a good point - very fast on CPU
2019-12-14 02:43:10 -05:00
Brandon Thomas
d1d3957310
Merge branch 'master' of github.com:echelon/voder
2019-12-13 03:47:06 -05:00
Brandon Thomas
26cb3bdaaf
(temporary GPU build break)
2019-12-13 03:46:46 -05:00
Brandon Thomas
5431902f8d
Merge branch 'master' of github.com:echelon/voder
2019-12-13 03:45:09 -05:00
Brandon Thomas
011690ce8b
(temporary GPU build break)
2019-12-13 03:44:54 -05:00
Brandon Thomas
e5f50002da
(temporary GPU build break)
2019-12-13 03:35:50 -05:00
Brandon Thomas
1958622d8c
generalize function
2019-12-11 04:24:22 -05:00
Brandon Thomas
95561e2568
signal reconstituted, but a bit loud
2019-12-11 04:14:48 -05:00
Brandon Thomas
774789c607
comment
2019-12-11 03:11:01 -05:00
Brandon Thomas
06d0bbcbba
spacing cleaup (minor), added cleaned sentence
2019-12-11 03:08:30 -05:00
Brandon Thomas
9dd998714a
This runs!
2019-12-11 02:52:47 -05:00
Brandon Thomas
15570be82d
Inputs and tensors appear to be correct - now need to get data/dims
2019-12-11 02:42:33 -05:00
Brandon Thomas
dd9362352e
Add 2nd binary to load tacotron (Keith Ito) model
2019-12-11 01:16:29 -05:00
Brandon Thomas
dee59f5f4c
Add 2nd binary for tacotron
2019-12-10 23:59:50 -05:00
Brandon Thomas
32a54e395d
record before (or right during) activating edge.
...
This keeps the beginning audio segment from being choppy.
2019-11-08 03:24:15 -05:00
Brandon Thomas
354c6a7261
Move sidecar out to own module
2019-11-08 02:29:12 -05:00
Brandon Thomas
37d8c9ec85
Move CPAL mic/speaker into new module
2019-11-08 01:56:57 -05:00
Brandon Thomas
16639c7bed
README multi-gpu, CycleGAN sample rate cleanup
2019-11-08 01:23:30 -05:00
Brandon Thomas
7f325513fb
This is almost realtime and should work in conversation
2019-10-21 04:11:03 -04:00
Brandon Thomas
89d3ae6362
heuristic for pausing the mic
2019-10-21 04:08:09 -04:00
Brandon Thomas
ed05ab1551
well, this is as best as the model does so far...
2019-10-21 03:37:08 -04:00
Brandon Thomas
fe5e15f206
This sounds good coming back down the pipe...
2019-10-21 03:23:01 -04:00
Brandon Thomas
21bc256478
This might be right up until sending back. Might just need an upsample!
...
Original audio - sounds good
Downsampled audio - sounds good
Model output - sounds good (might even be closer to trump, didn't test
enough)
Voder audio - squeaky. needs upsample probably
2019-10-21 03:18:02 -04:00
Brandon Thomas
4155fa4e36
this is a good shape for debugging
2019-10-21 03:12:26 -04:00
Brandon Thomas
f096ae07bf
Changing proto schema. Degradation in quality.
...
I had something really close. That might not have found it into a
commit between now and the last commit :(
2019-10-21 02:58:05 -04:00
Brandon Thomas
af20a57e8a
THIS EVALUATES THE MODEL IN REALTIME +3-6sec delay
...
Still doesn't sound right. Probably a sample rate issue.
2019-10-20 03:10:21 -04:00
Brandon Thomas
d63007ac9f
Experimenting - trying to figure out why audio sounds so bad
2019-10-20 02:50:18 -04:00
Brandon Thomas
7e33d9c7ca
Add my demo_server.py implementation from CycleGAN
2019-10-20 02:18:51 -04:00
Brandon Thomas
b38c96ae2f
Protobufs UP and DOWN. Sounds great!
2019-10-20 02:04:41 -04:00
Brandon Thomas
05b703068a
THIS SOUNDS FANTASTIC (no transform yet, 1:1 audio)
2019-10-20 01:51:55 -04:00
Brandon Thomas
6df1e8b072
Two way works over protobuf! Woo! This will be so much better...
2019-10-20 01:36:12 -04:00
Brandon Thomas
dc9983e45b
Protos in python
2019-10-20 01:17:25 -04:00
Brandon Thomas
45a8dc446e
Better proto pipeline
2019-10-20 00:48:18 -04:00
Brandon Thomas
1ae8aafd5a
Add protos. Temporarily commented out TensorFlow pieces
2019-10-20 00:38:04 -04:00
Brandon Thomas
47022cdeeb
Copy relevant CycleGAN code here.
...
master @ 1ca8b078c12d915bca1f57e822859fa20bd439c8
Date: Tue Oct 15 10:50:12 2019 -0400
2019-10-20 00:11:53 -04:00
Brandon Thomas
7c3f3255b0
STUPID VEC POP WAS THE ISSUE
2019-10-15 02:59:16 -04:00
Brandon Thomas
4b956e594f
get rid of unneeded loop
2019-10-15 02:45:18 -04:00
Brandon Thomas
86900188d8
super direct round trip
2019-10-15 01:49:38 -04:00
Brandon Thomas
708a728b85
simple audio roundtrip
2019-10-15 01:41:24 -04:00
Brandon Thomas
de07378bcb
cleanup!
2019-10-15 01:20:37 -04:00
Brandon Thomas
7916f7c307
this inquires about processed buffer length
2019-10-15 00:55:12 -04:00
Brandon Thomas
a6ac91331e
whellp, there's the data round trip. This is bad
2019-10-15 00:35:34 -04:00
Brandon Thomas
ff0a7d7922
sending successfully
2019-10-14 20:00:21 -04:00
Brandon Thomas
6464e6344d
fix formatting
2019-10-14 19:18:21 -04:00
Brandon Thomas
9f11012252
add CPAL
2019-10-14 19:14:47 -04:00
Brandon Thomas
8f611958a3
sending more data is better
2019-10-13 22:20:10 -04:00
Brandon Thomas
6d928fa7ec
cleanup speaker/mic
2019-10-13 21:49:23 -04:00
Brandon Thomas
64e4018640
This works with large byte buffers! Sidecar reconstitutes the audio
2019-10-13 21:42:32 -04:00
Brandon Thomas
592bebe823
drained send
2019-10-13 21:35:43 -04:00
Brandon Thomas
089aab7930
move model stuff to new file
2019-10-13 21:23:11 -04:00
Brandon Thomas
58cfbef65e
sending audio, but still very broken
2019-10-13 20:51:18 -04:00
Brandon Thomas
e88cc5ff24
ZeroMQ IPC (first steps)
2019-10-13 00:41:46 -04:00
Brandon Thomas
08d7fc6797
zeromq
2019-10-12 23:21:37 -04:00
Brandon Thomas
41e9e45fe7
start work on synthesis
2019-10-11 01:58:39 -04:00
Brandon Thomas
af2f5ba68e
Modify readme
2019-10-11 00:21:54 -04:00
Brandon Thomas
cd6b5a37fd
change how dep override is declared
2019-09-30 01:43:44 -04:00
Brandon Thomas
a66a084a84
same dimensions for input!
2019-09-23 20:02:00 -04:00
Brandon Thomas
3cd90ded8b
more OO
2019-09-23 01:42:25 -04:00
Brandon Thomas
5cc533061e
This returns a tensor...
2019-09-23 01:25:47 -04:00
Brandon Thomas
2377494231
Getting closer...
2019-09-23 01:23:30 -04:00
Brandon Thomas
b9bb56085e
this works with the model
2019-09-23 01:18:55 -04:00
Brandon Thomas
2364f770f2
Now dimensional issues:
...
>>> Tensor dims: [2, 2, 2]
2019-09-23 01:13:51.546620: W
tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at
conv_ops_fused_impl.h:692 : Invalid argument: input depth must be evenly
divisible by filter depth: 2 vs 24
2019-09-23 01:13:51.546627: W
tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at
conv_ops_fused_impl.h:692 : Invalid argument: input depth must be evenly
divisible by filter depth: 2 vs 24
thread 'main' panicked at 'Run success: {inner:0x5581658b56d0,
InvalidArgument: input depth must be evenly divisible by filter depth: 2
vs 24
[[{{node generator_A2B_3/h1_conv_gates/conv1d}}]]}',
src/libcore/result.rs:999:5
2019-09-23 01:14:34 -04:00
Brandon Thomas
2dd5894283
Found the names of the input and output tensors, now fixing args
...
Current runtime err:
```
2019-09-23 01:00:01.189765: W
tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at
transpose_op.cc:157 : Invalid argument: transpose expects a vector of
size 1. But input(1) is a vector of size 3
thread 'main' panicked at 'Run success: {inner:0x5589ea8b3860,
InvalidArgument: transpose expects a vector of size 1. But input(1) is a
vector of size 3
```
Getting there...!
2019-09-23 01:05:31 -04:00
Brandon Thomas
51b7fce129
Found the names of the input and output tensors, now fixing args
...
Current runtime err:
```
2019-09-23 01:00:01.189765: W
tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at
transpose_op.cc:157 : Invalid argument: transpose expects a vector of
size 1. But input(1) is a vector of size 3
thread 'main' panicked at 'Run success: {inner:0x5589ea8b3860,
InvalidArgument: transpose expects a vector of size 1. But input(1) is a
vector of size 3
```
Getting there...!
2019-09-23 01:00:55 -04:00
Brandon Thomas
3c715d9ef8
Merge branch 'master' of github.com:echelon/voder
2019-09-22 22:16:40 -04:00
Brandon Thomas
1201fc120a
this is a valid argument (used incorrectly)
2019-09-17 18:47:26 -04:00
Brandon Thomas
9f3f4f7d60
model loads!
2019-09-17 01:50:47 -04:00
Brandon Thomas
4f331f3f83
model loading works, but is from a wrong version of tensorflow
2019-09-16 11:18:16 -04:00
Brandon Thomas
2982a82999
feedback, adding tensorflow
2019-09-16 03:26:18 -04:00
Brandon Thomas
0483c2fe6e
comments and readme
2019-09-13 04:17:29 -04:00
Brandon Thomas
12440fe1fe
add old "main.rs" as "weird.rs", add debugging to beep
2019-09-13 02:14:15 -04:00
Brandon Thomas
9482fb2302
add wavy example code
2019-09-13 01:50:00 -04:00
Brandon Thomas
39bdce3380
Add more examples from cpal
2019-09-13 01:47:54 -04:00
Brandon Thomas
8479a64a6b
fixes in notes
2019-09-11 03:10:05 -04:00
Brandon Thomas
fc043c96a6
add cpal example
2019-09-11 02:40:40 -04:00
Brandon Thomas
5bb16790d3
sin wave
2019-09-11 01:48:51 -04:00
Brandon Thomas
71c0edf0e8
much better fidelity
2019-09-11 01:16:24 -04:00
Brandon Thomas
73afdc7a98
add threshold for noise
2019-09-11 01:13:24 -04:00
Brandon Thomas
737103239c
Update readme with instructions to change speaker
2019-09-11 00:53:11 -04:00
Brandon Thomas
cbb9be2074
wip
2019-09-06 03:21:03 -04:00
Brandon Thomas
1146bb057d
wow this sounds weird
2019-09-06 02:42:07 -04:00
Brandon Thomas
ad98211cb9
starting experiments
2019-09-06 01:22:57 -04:00
Brandon Thomas
c5a8db7537
Frontend copied into brandon.audio
2019-01-30 03:20:59 -05:00
Brandon Thomas
88c3fe71ad
Configs for DNS, add brandon.audio deploy script
2019-01-30 03:06:11 -05:00
Brandon Thomas
fd87bc4fbc
rename scripts for easier discoverability
2019-01-30 01:56:59 -05:00
Brandon Thomas
57eeb6926c
Rename script
2019-01-30 01:55:43 -05:00
Brandon Thomas
a0b68fbdd0
Update meta information and title
2019-01-30 01:54:24 -05:00
Brandon Thomas
c34b6358dc
README with old jungle.horse configs
2019-01-30 01:50:35 -05:00
Brandon Thomas
b09117bb87
todo
2019-01-30 00:55:49 -05:00
Brandon Thomas
758097445e
Update TODO
2018-09-17 02:06:21 -04:00
Brandon Thomas
a153a6e276
Where EBS container is hosted
2018-09-07 04:53:58 -04:00
Brandon Thomas
64d1e0eff3
Change HTML title
2018-09-07 04:32:01 -04:00
Brandon Thomas
3a66d5ac2e
Update for 'trumped.com'
2018-08-28 03:54:34 -04:00
Brandon Thomas
3d32bd2fbc
Trim down the index html of fluff
2018-06-12 04:52:32 -04:00
Brandon Thomas
473ea31f4d
Rebuild arpabet override / changes file from diff
2018-06-12 04:04:10 -04:00
Brandon Thomas
5521c47ebc
move legacy use of 'try!' to '?'
2018-06-11 02:34:42 -04:00
Brandon Thomas
b68009408c
Update to utilize arpabet.rs
2018-06-11 02:24:39 -04:00
Brandon Thomas
5f9d50c154
First update to build deps after years
2018-06-10 18:02:49 -04:00
Brandon Thomas
42533a9d0e
Fix CDN host cdn.{junglehorse.com -> jungle.horse}
...
I'm letting junglehorse.com expire.
2017-01-14 02:17:09 -05:00
Brandon Thomas
cf5288e913
add bigly
2016-11-08 16:14:13 -05:00
Brandon Thomas
71d10d2cf2
A few words
2016-11-08 04:39:35 -05:00
Brandon Thomas
ab6924878a
Add Google Analytics tracker
2016-11-08 01:46:12 -05:00
Brandon Thomas
d0c9c98031
misc fixes
2016-11-07 03:29:39 -05:00
Brandon Thomas
94e8ba93cb
enable caching in prod
2016-11-07 01:29:30 -05:00
Brandon Thomas
bbea7ad9ff
fixes
2016-11-07 01:28:11 -05:00
Brandon Thomas
b5ee9a8980
Limit number of words or characters in the request
...
Config options for both.
2016-11-07 01:18:53 -05:00
Brandon Thomas
00db0b5854
server param for logging raw sentence
2016-11-07 00:50:42 -05:00
Brandon Thomas
28036a3702
add more words to custom dictionaries
2016-11-07 00:43:35 -05:00
Brandon Thomas
da5ba07365
upload script for new jungle.horse S3 bucket (oops)
2016-11-07 00:13:54 -05:00
Brandon Thomas
4c44cd498a
Update frontend, deploy script to use "static" image asset URLs
2016-11-06 23:53:36 -05:00
Brandon Thomas
a7c880caf9
Remove old HTML pages and demo HTML handler
2016-11-06 22:58:12 -05:00
Brandon Thomas
a04174cfda
Deploy backend to AWS Elastic Beanstalk (EBS)
...
- Docker configs for AWS EBS
- Script to build artifact containing the Rust binary, configs, wav
files, and Docker configs.
- Add documentation.
2016-11-06 22:16:58 -05:00
Brandon Thomas
2d92776c3a
favicon, debug
2016-11-06 06:21:47 -05:00
Brandon Thomas
a393a76920
add CDN host (perhaps not necessary?)
2016-11-06 05:55:06 -05:00
Brandon Thomas
ccfbefddd1
Inject API host into the javascript (hack again)
2016-11-06 05:16:59 -05:00
Brandon Thomas
5c6cd281c4
fix cdn paths, add static error page
2016-11-06 05:05:22 -05:00
Brandon Thomas
6841ac7783
Fix paths in s3 upload by path substitution hack
...
Such a hacky thing to do...
2016-11-06 04:22:39 -05:00
Brandon Thomas
76791e5e0e
adding bucket configs (no credentials / secrets)
2016-11-06 02:18:42 -05:00
Brandon Thomas
0ac50320e1
Add S3 deploy script
2016-11-06 01:35:58 -05:00
Brandon Thomas
ac74a5fede
Redesign DOM, add modal
...
- added an about modal
- donation links
2016-11-05 22:00:13 -04:00
Brandon Thomas
bb751edc0a
turn on syllables by default
2016-11-04 02:51:57 -04:00
Brandon Thomas
d9c315fc28
animation, part 2
...
- minify flag for webpack
- add second animation
- fix existing animation (transition between stop and idle)
- abstraction of animation code into new class
2016-11-04 02:41:04 -04:00
Brandon Thomas
b358895089
Sample prefs on syllables
...
- Fix bug(s) preventing syllable system from working
- Add logging
- Add many syllable heuristics.
2016-11-03 02:58:09 -04:00
Brandon Thomas
9ba0eeb090
bump server version
2016-11-02 03:29:25 -04:00
Brandon Thomas
eeb213bb76
Better syllable synthesis
...
- Polysyllable fulfillment algorithm
- w/ debug padding
- Still needs "ends" support
- Lots of cleanup and improvement to syllable code
- Added Polysyllable and Polysyllabic trait
- Updated syllable heuristics for 3-syllable stretches
- 4-syllable parsing
- syllable debug logging + config
2016-11-02 03:26:09 -04:00
Brandon Thomas
b011ce4b87
First implementation of "use syllables".
2016-11-01 03:34:29 -04:00
Brandon Thomas
c232ec9534
more needed words
2016-11-01 02:49:08 -04:00
Brandon Thomas
def50e48d5
basic loadtest script (actually, this sucks)
2016-10-30 06:27:38 -04:00
Brandon Thomas
cdd9d4bac4
typescript build fixes
2016-10-30 05:34:10 -04:00
Brandon Thomas
32248e9e36
Fix UI "clear" button to clear URL state
2016-10-30 03:04:57 -04:00
Brandon Thomas
0ea02db27f
Refactor of synthesis-related code
...
- refactor and modularize code into "sentence synth" and "word synth"
- change synth params in code and UI
- change error types, better error handling
2016-10-30 02:25:52 -04:00
Brandon Thomas
3344acf6db
move parser dep from synthesizer to handler
2016-10-28 01:05:10 -04:00
Brandon Thomas
20f2f7a2ad
cleanup, move effects mod into synthesis::effects
2016-10-28 00:47:51 -04:00
Brandon Thomas
43a731b05e
request hashing move to request struct, tests++
2016-10-28 00:29:01 -04:00
Brandon Thomas
22d77a7c95
Remove old "diphones" param, add (unused) syllables param
2016-10-28 00:01:57 -04:00
Brandon Thomas
63d6b3257f
Cleanup audio synth handler
...
So much bad early code.
2016-10-27 23:48:14 -04:00
Brandon Thomas
90a0e367fa
Syllable-based synthesis (WIP)
...
- Vowels indicate syllable
- Algorithm tracks consonants and uses heuristics to attach them to a
vowel island.
- Still work in progress.
2016-10-27 01:27:55 -04:00
Brandon Thomas
fd4bfbe920
Change logo
2016-10-25 21:33:27 -04:00
Brandon Thomas
c6389a50bc
don't animate on 500
2016-10-25 05:05:21 -04:00
Brandon Thomas
1b4e220b52
Cleanup, error handling
2016-10-25 05:02:26 -04:00
Brandon Thomas
c983e88a0b
bump to ver 0.11.0, add more abbreviations
2016-10-25 04:15:18 -04:00
Brandon Thomas
cc71a9d8b6
Date parsing
2016-10-25 03:53:36 -04:00
Brandon Thomas
db9e412495
Synthesize currency values, eg. "$10 million"
2016-10-25 00:47:16 -04:00
Brandon Thomas
0bebea4a0e
Typescript + Vuejs
2016-10-24 23:52:53 -04:00
Brandon Thomas
adabd2b588
bump server version to 0.9.0
2016-10-22 19:21:28 -04:00
Brandon Thomas
9b12fbacdc
Pass tokens to synthesizer intead of strings
...
- Enables "pauses" for punctuation
- Enables "filler words" like "uh" for unknown words
2016-10-22 18:18:11 -04:00
Brandon Thomas
aa9f5e9dad
Use IntelliJ-Rust for development; include configs
2016-10-22 01:43:20 -04:00
Brandon Thomas
208f544e36
autofocus
2016-10-20 04:55:11 -04:00
Brandon Thomas
cd3bb6a3f2
URL state
2016-10-20 04:10:37 -04:00
Brandon Thomas
66b746f4d2
swap old frontend for new one (without image)
2016-10-20 02:47:57 -04:00
Brandon Thomas
c6840a88d4
Begin new frontend code
2016-10-20 02:39:26 -04:00
Brandon Thomas
5fc8f0610c
Move old typescript code to new frontend directory
2016-10-20 00:46:22 -04:00
Brandon Thomas
31eb0ea2b7
Move old frontend UI code to new directory
2016-10-20 00:35:15 -04:00
Brandon Thomas
b9e199f08d
Responsive versions of each.
2016-10-18 03:38:53 -04:00
Brandon Thomas
053dbda1e2
rename
2016-10-18 03:30:15 -04:00
Brandon Thomas
bae724525d
First iteration on new UI
2016-10-18 03:28:43 -04:00
Brandon Thomas
c6c3084a07
Cleanup handler setup, static asset serving
2016-10-18 03:10:59 -04:00
Brandon Thomas
beb8303884
Static HTML handler
...
Maybe slightly wasted effort, but maps routes to static HTML files.
Will be good for doing several demos / concepts and hosting the old UI.
2016-10-18 01:39:02 -04:00
Brandon Thomas
1efcb1e0d5
dictionary updates
2016-10-16 23:49:06 -04:00
Brandon Thomas
49547edf42
5-phones
2016-10-15 23:32:16 -04:00
Brandon Thomas
46961eb43d
w/ with
2016-10-15 19:11:00 -04:00
Brandon Thomas
a70151d1f1
add "o'clock" to times
2016-10-15 17:46:41 -04:00
Brandon Thomas
a3ecab05f0
Time parsing
2016-10-15 17:32:56 -04:00
Brandon Thomas
493749a86d
time tokenizing
2016-10-14 02:44:19 -04:00
Brandon Thomas
52f986ad0d
Twitter username and hashtag parsing
2016-10-13 03:22:08 -04:00
Brandon Thomas
86155ea998
Update build script, bump version number
2016-10-13 01:30:43 -04:00
Brandon Thomas
202c290e1f
CamelCase parsing to word expansion
2016-10-13 01:23:15 -04:00
Brandon Thomas
e00d8abe0e
Parse hyphenated words into words if in dictionary
2016-10-13 00:55:16 -04:00
Brandon Thomas
e8ab38fda0
Cleanup symbol pattern matching
2016-10-13 00:08:31 -04:00
Brandon Thomas
376b19fc06
Currency symbol tokenizing
2016-10-12 23:50:04 -04:00
Brandon Thomas
514656f296
additional test
2016-10-12 22:44:36 -04:00
Brandon Thomas
0c4a69ba4a
CamelCase tokenizing
2016-10-12 22:42:41 -04:00
Brandon Thomas
c0a284a1ac
Tokenize (but do not parse) hyphenated words
2016-10-12 22:05:04 -04:00
Brandon Thomas
fd45d9416a
plus symbol
2016-10-12 21:41:09 -04:00
Brandon Thomas
dbc776292a
easier to read logs; dictionary tweaks
2016-10-12 02:04:44 -04:00
Brandon Thomas
90d91f731f
ordinal bugfix
2016-10-12 00:24:49 -04:00
Brandon Thomas
bb5d9aca1c
Ordinal tokenization and rendering
2016-10-11 23:57:51 -04:00
Brandon Thomas
3228cf5e12
Add state abbreviations
...
Only some work since there are arpabet entries. I don't care to override
them at this time.
2016-10-11 21:50:30 -04:00
Brandon Thomas
c319b82462
add arpabet words, remove parens, etc.
2016-10-11 03:59:52 -04:00
Brandon Thomas
f9fd557a27
log timing
2016-10-10 04:02:38 -04:00
Brandon Thomas
03a3e24d8b
Handle percentages
2016-10-10 03:44:23 -04:00
Brandon Thomas
3f29bed4ad
get rid of junk (square brackets, asterisk, etc.)
2016-10-10 03:31:37 -04:00
Brandon Thomas
635cd41fbe
Bump server version
2016-10-10 03:07:48 -04:00
Brandon Thomas
28aee28c12
Number parsing
...
Enables audio synthesis of numbers.
2016-10-10 03:04:01 -04:00
Brandon Thomas
535829e791
Add TODO file to keep track of goals
2016-10-09 18:51:41 -04:00
Brandon Thomas
99f84354ad
Add an abbreviations system
...
- Abbreviations file maps abbreviations to a word list.
- This will function diffrently than initialisms, which are pronounced
letter by letter.
2016-10-09 18:40:07 -04:00
Brandon Thomas
4557780803
Updates to deploy script
2016-10-08 17:02:10 -04:00
Brandon Thomas
86a3aeef09
Bump server version
2016-10-08 14:30:07 -04:00
Brandon Thomas
9b8263815b
Improved code and quality of tokenization
...
- Distinct rounds of tokenization
- Split into modules
- Cleanup
2016-10-08 14:28:11 -04:00
Brandon Thomas
1850dfe418
dashes and emoji tokenization, added tests
...
- emoji tokenization is WIP
2016-10-06 03:26:40 -04:00
Brandon Thomas
18b3e0cfdf
Bump server version
2016-10-06 02:50:50 -04:00
Brandon Thomas
6524be41e1
Configurable logging contexts; refactored logging
...
Logging from each component (parsing, synthesis, HTTP server) now logs
as its own target. Configuration options enable turning on or off each
component so it's easy to isolate a component for debugging.
2016-10-06 02:46:29 -04:00
Brandon Thomas
c37c07efc0
Update configs based on the system in tweetspeak
...
configs have a default set and a hostname-specified set that act as
overrides.
2016-10-06 01:27:09 -04:00
Brandon Thomas
343c7f7092
Actually implement a tokenizing pipeline
...
Split "tokenizing" and "parsing". It isn't quite CS theory, but it makes
things easier to test and maintain.
2016-10-06 00:59:00 -04:00
Brandon Thomas
ca2d3eb2b7
Bump hound (wav library) major version
2016-10-03 22:22:28 -04:00
Brandon Thomas
6eadf185d2
Bump dependency versions
2016-10-03 22:20:32 -04:00
Brandon Thomas
5fc4592369
fix smart quote
2016-10-03 22:18:30 -04:00
Brandon Thomas
ea0fb8efcc
fix emdashes, smart quotes, periods w/ quotes
2016-10-02 17:29:42 -04:00
Brandon Thomas
f74f93da1c
Bump server version
2016-10-02 16:35:02 -04:00
Brandon Thomas
c7224d4838
Cleanup, fix compile warnings
2016-10-02 16:32:56 -04:00
Brandon Thomas
f86f6aa3ea
Foundations for sentence tokenization (WIP)
...
- Sentence parsing and correction moved into a single module
- Typesafe "Speaker" parameter
- Regex + lazy_static!
2016-10-02 15:28:48 -04:00
Brandon Thomas
3a6b201ae0
Deploy script
2016-09-30 01:41:17 -04:00
Brandon Thomas
13ba34d0b3
words, readme
2016-09-27 05:16:03 -04:00
Brandon Thomas
7e302e7665
Word audio spacing params + handler cleanup
2016-09-20 05:19:16 -04:00
Brandon Thomas
4ce9909b4e
Add work-related dictionary for fun
2016-09-20 04:27:06 -04:00
Brandon Thomas
d9352990c7
Add new words
2016-09-20 02:13:02 -04:00
Brandon Thomas
952db53020
Add more words (jigglypuff!)
2016-09-20 01:49:17 -04:00
Brandon Thomas
59f29166ea
more words
2016-09-18 07:58:47 -04:00
Brandon Thomas
ec72a3c832
Rename "_words" directory to "words"
2016-09-18 06:22:22 -04:00
Brandon Thomas
4e9ce2628f
additions to arpabet dictionary
2016-09-18 04:46:39 -04:00
Brandon Thomas
6cb4dac63b
Support - in arpabet.
2016-09-18 01:43:51 -04:00
Brandon Thomas
196744b976
Fix bug
2016-09-18 00:49:20 -04:00
Brandon Thomas
a2850f63ee
dictionary work, etc.
2016-09-16 04:00:24 -04:00
Brandon Thomas
931f195347
Extra phonemes, fixup words
2016-09-16 02:18:10 -04:00
Brandon Thomas
91d0ab9e67
Improved monophones wrt. ends
2016-09-16 02:17:40 -04:00
Brandon Thomas
a5dcdca16e
Custom arpabet dictionary
2016-09-16 02:08:47 -04:00
Brandon Thomas
c80cf6715a
Add start/end concept to the n-phone-based synth
2016-09-16 02:06:34 -04:00
Brandon Thomas
b2d2d48894
I'm going to hell for some of these words :P
2016-09-13 00:50:21 -04:00
Brandon Thomas
65a3dcad7b
maintain own "cleared" state in UI
2016-09-10 18:34:37 -04:00
Brandon Thomas
0e8a469db1
added more missing words
2016-09-10 18:25:49 -04:00
Brandon Thomas
e87bb21475
UI improvements
2016-09-10 18:20:10 -04:00
Brandon Thomas
6e7afc677a
Forgot to check this in awhile ago
2016-09-10 17:56:30 -04:00
Brandon Thomas
990faf3092
Add a WaveForm UI component (WaveSufer)
...
- Drop buzz.js for wavesurfer.js
- Wrapper in TypeScript / Webpack instead of Javascript / Gulp
2016-09-10 17:55:19 -04:00
Brandon Thomas
9004b204ed
Fix n-phone bug
2016-09-10 12:40:57 -04:00
Brandon Thomas
23bd68c761
Allow apostrophe - fix in arpabet regex
2016-09-10 03:21:22 -04:00
Brandon Thomas
c7b34146af
cleanup, words
2016-09-08 05:32:30 -04:00
Brandon Thomas
b0169fac5e
Added a file tracking words I need to add
2016-09-08 04:40:20 -04:00
Brandon Thomas
93f3a2d372
Synthesize using n-phones!
...
n-phones comprise monophones, diphones, 3-phones, and more.
This algorithm allows for smoother sounding synthesis.
Also updates the UI for a new n-phones option and adds/updates
scripts related to the arpabet with respect to n-phones.
2016-09-08 04:36:49 -04:00
Brandon Thomas
a6eb7ad539
Script to determine longest lengths of phonemes
2016-09-07 01:49:53 -04:00
Brandon Thomas
9b0e4d4a8c
Add arpabet n-phone histogram tool
2016-09-06 23:59:49 -04:00
Brandon Thomas
4425d17d29
Serverside + UI for making diphones an option
2016-09-06 03:38:56 -04:00
Brandon Thomas
c9f0613dd3
Add initial diphone support!
2016-09-06 03:26:17 -04:00
Brandon Thomas
24faba4af1
add "start" and "end" syllables
2016-09-06 00:31:33 -04:00
Brandon Thomas
9fadaa3a55
fix boolean defaults again
2016-09-02 01:11:37 -04:00
Brandon Thomas
9c507e5a47
fix UI bugs (non-persist checkbox, etc.)
2016-09-02 01:05:23 -04:00
Brandon Thomas
159eff2a1e
Added phoneme padding params and pause synthesis
2016-09-02 00:20:10 -04:00
Brandon Thomas
489aff2540
Ability to change speed + UI; also refactor volume
...
- Speed is an effect that stretches the waveform.
- Volume is now an effect.
- Poor UI added for speed component.
2016-09-01 02:04:41 -04:00
Brandon Thomas
740e3c7eec
really fix phoneme wavspec bug !
2016-08-30 02:17:44 -04:00
Brandon Thomas
0009f9b034
turn on/off caching with config option
2016-08-30 02:06:53 -04:00
Brandon Thomas
6fd6581324
Add username creation details
2016-08-30 01:35:30 -04:00
Brandon Thomas
b24f5102c0
More readme updates
2016-08-30 01:08:47 -04:00
Brandon Thomas
cbe6a2d7db
Add nginx config to readme
2016-08-30 00:59:44 -04:00
Brandon Thomas
9a9fbacde1
fix small _blank bug on phoneme-only
2016-08-29 23:55:28 -04:00
Brandon Thomas
04c06bbba4
use_phonemes, use_words options
2016-08-29 22:40:57 -04:00
Brandon Thomas
de8a8636b4
Upgrade Iron HTTP stack
2016-08-29 22:13:41 -04:00
Brandon Thomas
cf70aebc7e
prep for new parameters (need to upgrade iron)
2016-08-29 22:04:56 -04:00
Brandon Thomas
6ada19f32c
hack to work on local and prod environments
2016-08-26 01:51:16 -04:00
Brandon Thomas
6c0c0118ff
add static to unmapped (word->phonemes)
2016-08-24 03:36:24 -04:00
Brandon Thomas
9f3b0b8059
cleanup, minor safety improvements
2016-08-24 03:25:52 -04:00
Brandon Thomas
f90fe671ff
Synthesis with phonemes
...
Changes the filesystem structure a bit, introduces new wave file
reader and dictionaries, etc.
2016-08-24 03:03:21 -04:00
Brandon Thomas
ae55dd9514
Read CPU Arpabet dictionary
2016-08-23 03:04:07 -04:00
Brandon Thomas
32a6d5f259
Add Regex dependency
2016-08-23 02:18:53 -04:00
Brandon Thomas
4605b00206
minor update to readme, script wrt phoneme
2016-08-23 00:31:23 -04:00
Brandon Thomas
ea9249a62a
Merge branch 'master' of github.com:echelon/trumpet
2016-08-22 02:18:10 -04:00
Brandon Thomas
5d56da645a
README, word-phoneme dict, phoneme progress script
...
- Updated README a little
- Added a word-to-phoneme dictionary (CMU open source)
- Added a Python script to track progress on phonemes
2016-08-22 02:16:47 -04:00
Brandon Thomas
4f79e3d719
get system hostname
2016-08-02 01:29:51 -04:00
Brandon Thomas
730b81a9d9
get system hostname
2016-06-25 21:23:53 -04:00
Brandon Thomas
b0be23f618
Add TypeScript/Webpack based test page
2016-06-25 18:11:29 -04:00
Brandon Thomas
6325246417
Added a /test route
2016-06-25 01:37:16 -04:00
Brandon Thomas
cbb1a128fe
Read a config file for paths
2016-06-18 01:58:37 -04:00
Brandon Thomas
29af59d8f3
uncommitted praat changes
2016-06-18 00:51:52 -04:00
Brandon Thomas
f0fdba9ee5
example praat scripts
2016-04-29 01:33:30 -04:00
Brandon Thomas
d59e5403ed
adjust paths
2016-04-26 01:44:57 -04:00
Brandon Thomas
d5b7ab92a0
Add Praat segment script found online
2016-04-26 01:42:49 -04:00
Brandon Thomas
d4280bb399
Add a spectrogram script found online
2016-04-10 01:50:21 -04:00
Brandon Thomas
efee5a8bce
cleanup
2016-03-06 04:51:39 -05:00
Brandon Thomas
cc3300e0a3
cleanup rust handler
2016-03-06 04:50:50 -05:00
Brandon Thomas
3f9b37c28b
Slight cleanup of UI for volume
2016-03-06 04:34:15 -05:00
Brandon Thomas
8d2637ea72
JS/UI for sending volume
2016-03-06 04:28:31 -05:00
Brandon Thomas
91a61537bb
Fixed volume parameter
2016-03-06 04:10:34 -05:00
Brandon Thomas
e6d8b1dbdb
rust server: volume request parameter
2016-03-06 03:19:04 -05:00
Brandon Thomas
1c709b582e
cleanup python loudness script
2016-03-06 02:30:54 -05:00
Brandon Thomas
8349bad20f
Python script to make WAV files louder
2016-03-06 01:31:08 -05:00
Brandon Thomas
203bafb79e
fixup esc key binding
2016-02-11 06:57:50 -05:00
Brandon Thomas
c10819df72
form autocomplete off, link to JSON endpoint
2016-02-11 06:50:24 -05:00
Brandon Thomas
12bfb9274f
fix voice initialization errors
2016-02-11 06:41:45 -05:00
Brandon Thomas
86ab91e082
URLs are stable for both speakers now
2016-02-11 06:31:10 -05:00
Brandon Thomas
d8767823b9
title change
2016-02-11 05:42:03 -05:00
Brandon Thomas
0025cb81db
mobile ui fix, stats fix, typeahead state fix
2016-02-11 05:38:37 -05:00
Brandon Thomas
e24c87c76f
basic dropdown support (still wip w/ URL, style)
2016-02-11 05:25:56 -05:00
Brandon Thomas
717b5a3758
rust audio synth backend is multi-voice
2016-02-11 05:10:08 -05:00
Brandon Thomas
266ac9cbc1
javascript rewrite (/speak endpoint still WIP)
2016-02-11 04:15:51 -05:00
Brandon Thomas
7658d602e2
frontend rewrite (wip, not working)
2016-02-10 04:30:40 -05:00
Brandon Thomas
c1860ee33d
reorganize
2016-02-10 04:11:01 -05:00
Brandon Thomas
9555aeff18
serve new JSON payload (incomplete)
2016-02-10 04:07:20 -05:00
Brandon Thomas
08be337ae0
Adding dictonary of words read
2016-02-10 03:45:01 -05:00
Brandon Thomas
62758a7285
play sounds with buzz.js
2016-02-10 02:12:31 -05:00
Brandon Thomas
44fe6d4cdf
minify, set ui color state
2016-02-02 04:43:34 -05:00
Brandon Thomas
00c0930d0a
cleanup javascript
2016-02-02 04:34:53 -05:00
Brandon Thomas
9c4bdd76ff
Autoplay / URL change state
2016-02-02 04:27:12 -05:00
Brandon Thomas
811a86af0b
Sentence padding, word count stats, etc.
2016-02-01 05:38:29 -05:00
Brandon Thomas
31399665f9
really crude typeahead ui
2016-01-26 03:26:29 -05:00
Brandon Thomas
98b5aef641
add empty sounds/ dir
2016-01-26 02:43:14 -05:00
Brandon Thomas
dfa3661a13
Typing now informs UI state
2016-01-24 15:46:32 -05:00
Brandon Thomas
46c9d5486f
raw js/dom -> js/jquery
2016-01-24 14:30:48 -05:00
Brandon Thomas
aacff3c1ce
Gulp/Bower workflow for Javascript
2016-01-24 14:17:55 -05:00
Brandon Thomas
61b169392c
ignore bower components
2016-01-24 12:23:45 -05:00
Brandon Thomas
9dcdc2542a
Bower for JS dependency management
2016-01-24 12:20:03 -05:00
Brandon Thomas
ef11ef421b
Add requirements.txt for fabistrano deploys
2016-01-02 05:56:49 -05:00
Brandon Thomas
27e000c9a9
Character encoding, prevent page redirect
2016-01-02 03:47:44 -05:00
Brandon Thomas
4ac33dcef0
CLI option for port number
2016-01-02 03:35:52 -05:00
Brandon Thomas
44dae5d64a
Bump dependency versions (hound,etc.)
2015-12-31 22:50:59 -05:00
Brandon Thomas
540e664b19
ETag-based caching
2015-12-11 03:51:11 -05:00
Brandon Thomas
b230e2674e
Add logger
2015-12-10 05:39:45 -05:00
Brandon Thomas
2b1c0f84bb
Cleanup
2015-12-10 05:30:19 -05:00
Brandon Thomas
ae59d9fd57
Adding error filters / middleware
2015-12-10 05:24:15 -05:00
Brandon Thomas
57c7114c37
style updates
2015-12-09 05:51:07 -05:00
Brandon Thomas
6c61dfff11
style improvement
2015-12-09 05:37:13 -05:00
Brandon Thomas
720f851343
Web interface
2015-12-09 05:31:30 -05:00
Brandon Thomas
8c937995fa
Serve static files
2015-12-09 04:36:15 -05:00
Brandon Thomas
795074d112
audio synth endpoint works
2015-12-08 03:33:27 -05:00
Brandon Thomas
77f0c504df
Work in progress on handlers
2015-12-08 01:59:59 -05:00
Brandon Thomas
e2ebba0aca
Vocab list endpoint returns JSON
2015-12-05 04:12:31 -05:00
Brandon Thomas
357887ec9e
Add cargo.lock
2015-12-04 05:00:41 -05:00
Brandon Thomas
08d1989e6e
Words from command line arguments
2015-12-04 04:21:55 -05:00
Brandon Thomas
e232d20c46
Adding Iron/Hyper server (initial work)
2015-12-04 04:01:58 -05:00
Brandon Thomas
014c15e793
cleanup
2015-12-03 02:54:00 -05:00
Brandon Thomas
c0ea0b8fd8
Cleanup.
...
Sorry for committing all of this to master. I'll rebase and force push
later to cleanup.
2015-08-31 04:30:24 -04:00
Brandon Thomas
321cbe50be
WAV codec and some sample data to mix.
2015-08-31 04:26:17 -04:00
Brandon Thomas
093757f635
Trying SDL-mixer 2.0
2015-08-31 01:37:28 -04:00
Brandon Thomas
b65fed7b00
Repo init, some Rust deps.
...
- Initialize repo.
- Include some plausible rust dependencies.
2015-08-30 23:15:08 -04:00