saltacc
25b90c07ce
add model downloading
2023-12-18 15:49:55 -08:00
saltacc
2f971dda60
add model downloading
2023-12-13 21:17:44 -08:00
saltacc
b30c352d79
pass tests
2023-12-13 16:29:45 -08:00
saltacc
cb2d36401c
merge rerender a video
2023-12-13 16:12:30 -08:00
Brandon Thomas
7dea4c64fa
Merge pull request #208 from storytold/brandon-more-rate-limiter-fixes
...
more rate limiter fixes
2023-12-13 17:04:14 -05:00
Brandon Thomas
9ab8e52211
more rate limiter fixes
2023-12-13 16:58:37 -05:00
Brandon Thomas
81dd377599
clean up and test rate limiter choice code
2023-12-13 15:27:34 -05:00
Brandon Thomas
e641f26d21
Merge pull request #207 from storytold/brandon-ai-streamer-support
...
Rate limiter support for AI streamers
2023-12-13 13:35:51 -05:00
Brandon Thomas
3766758cfb
Rate limiter support for AI streamers
2023-12-13 13:33:48 -05:00
Brandon Thomas
196be25fb5
voice takedown requests
2023-12-13 11:04:13 -05:00
salt
57e2f70707
WORKING!
2023-12-12 23:07:27 -08:00
salt
292b831d16
update tests
2023-12-12 17:36:53 -08:00
salt
d51ee67d4c
complete failure
2023-12-12 17:35:36 -08:00
Brandon Thomas
e375c8090c
fix IDE handling (code compiled and tested, but IDE unhappy)
2023-12-12 19:21:42 -05:00
Brandon Thomas
e5a85c7528
fix failing doctest
2023-12-12 18:56:02 -05:00
salt
14432cce83
fix errors
2023-12-12 15:12:34 -08:00
salt
43030402ca
update
2023-12-12 14:50:50 -08:00
salt
2d59c5c573
initial commit
2023-12-12 13:47:12 -08:00
Brandon Thomas
18309385b4
Merge pull request #204 from storytold/brandon-nix-newrelic
...
Kill newrelic. This is painful to keep upgrading
2023-12-12 11:58:33 -05:00
Brandon Thomas
f9ff9b8c9f
Kill newrelic. This is painful to keep upgrading
...
Keeping the vendor directory because we may introduce later. We've
already done some upkeep.
2023-12-12 11:57:42 -05:00
Brandon Thomas
d22d64fac7
Merge pull request #195 from storytold/fix_warnings
...
Fix some warnings
2023-12-12 03:44:46 -05:00
Brandon Thomas
08d8e5279e
Merge pull request #201 from storytold/dependabot/cargo/version-sync-0.9.5
...
Bump version-sync from 0.8.1 to 0.9.5
2023-12-12 03:43:43 -05:00
dependabot[bot]
d9fe4e56a0
Bump version-sync from 0.8.1 to 0.9.5
...
Bumps [version-sync](https://github.com/mgeisler/version-sync ) from 0.8.1 to 0.9.5.
- [Release notes](https://github.com/mgeisler/version-sync/releases )
- [Commits](https://github.com/mgeisler/version-sync/compare/0.8.1...0.9.5 )
---
updated-dependencies:
- dependency-name: version-sync
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-12 08:00:32 +00:00
Brandon Thomas
dcf6451693
Merge pull request #199 from storytold/dependabot/cargo/hyper-tls-0.6.0
...
Bump hyper-tls from 0.5.0 to 0.6.0
2023-12-12 02:57:31 -05:00
Brandon Thomas
dbe3d5e977
Merge pull request #200 from storytold/dependabot/cargo/tokio-1.34.0
...
Bump tokio from 0.1.22 to 1.34.0
2023-12-12 02:56:41 -05:00
Brandon Thomas
07750fa122
refactor bucket modules
2023-12-12 02:55:23 -05:00
Brandon Thomas
795eb7a141
spacing nit
2023-12-12 02:15:06 -05:00
Brandon Thomas
d49b01930e
Merge pull request #198 from storytold/dec-07-mithoo-bookmarks
...
Rename favorites -> user_bookmarks, add new table
2023-12-11 23:36:22 -05:00
Brandon Thomas
052e4bfbd8
Merge pull request #203 from storytold/brandon-seed-media-files-2
...
seed video files + fix idempotency
2023-12-11 22:11:00 -05:00
Brandon Thomas
30d6bca9b2
seed video files + fix idempotency
2023-12-11 21:53:31 -05:00
Brandon Thomas
94d62736ad
Merge pull request #202 from storytold/brandon-seed-media-files
...
Seed media files
2023-12-11 21:07:08 -05:00
Brandon Thomas
1cde23c080
Seed media files
2023-12-11 20:52:20 -05:00
dependabot[bot]
d3be9a3a6b
Bump tokio from 0.1.22 to 1.34.0
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 0.1.22 to 1.34.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-0.1.22...tokio-1.34.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-11 22:09:11 +00:00
dependabot[bot]
c09adc3729
Bump hyper-tls from 0.5.0 to 0.6.0
...
Bumps [hyper-tls](https://github.com/hyperium/hyper-tls ) from 0.5.0 to 0.6.0.
- [Commits](https://github.com/hyperium/hyper-tls/compare/v0.5.0...v0.6.0 )
---
updated-dependencies:
- dependency-name: hyper-tls
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-11 22:08:50 +00:00
Michael Chung
e78cdf85e3
Upload weights front end side done,
...
need to write the download code then run inference depending on the model.
2023-12-11 14:40:14 -05:00
kasisnu
5971d95a80
Rename favorites -> user_bookmarks, add new table
2023-12-11 21:08:33 +05:30
Brandon Thomas
602de6d736
env vars
2023-12-08 05:15:13 -05:00
Brandon Thomas
de8eb05db6
inference-job - sadtalker to work with image media files
2023-12-08 04:45:28 -05:00
Brandon Thomas
996f8ce05b
inference-job : sad talker to use audio media files
2023-12-08 04:38:46 -05:00
Brandon Thomas
b4afec5c26
rename endpoint (internally)
2023-12-08 04:21:16 -05:00
Brandon Thomas
ab1f81036f
update my-workspace-hack
2023-12-08 04:00:42 -05:00
Brandon Thomas
4a806e7d67
codegen db
2023-12-08 02:16:50 -05:00
Brandon Thomas
c811296bdc
temporarily disable test
2023-12-08 02:04:34 -05:00
Brandon Thomas
6033289a36
fix most tests and lints
2023-12-08 01:36:39 -05:00
Brandon Thomas
90ec14b8d0
vendored needs to refer to workplace-hack
2023-12-08 01:27:10 -05:00
Brandon Thomas
e18b86a55a
everything needs to refer to workplace-hack
2023-12-08 01:25:49 -05:00
salt
d39962491f
fix some warnings (mostly unnecessary mut)
2023-12-07 18:36:51 -08:00
ArEnSc
6c320dd329
Merge pull request #180 from storytold/feature/weights_endpoints
...
Feature/weights endpoints WIP
2023-12-07 20:15:55 -05:00
Michael Chung
fd95aaff8c
Merge branch 'feature/weights_endpoints' of https://github.com/storytold/storyteller-rust into feature/weights_endpoints
2023-12-07 20:02:02 -05:00
Michael Chung
8afd10c864
minor fixes to spelling
2023-12-07 17:52:21 -05:00
ArEnSc
0e62fe9d08
Merge branch 'master' into feature/weights_endpoints
2023-12-07 00:35:53 -05:00
Michael Chung
dda2e0840d
Updated docs and weights_types
2023-12-07 00:25:57 -05:00
Michael Chung
b26276cfda
done now for code
2023-12-06 23:36:20 -05:00
Brandon Thomas
eedbc346fe
Merge pull request #194 from storytold/brandon-tts-as-media-file
...
Save TTS results as media files
2023-12-06 23:33:51 -05:00
Brandon Thomas
7976f68fd0
Save TTS results as media files
2023-12-06 23:31:47 -05:00
Michael Chung
f327dfcdbb
Builds and docs work
2023-12-06 23:27:34 -05:00
Michael Chung
f4176bf84a
Alright should fix the generation now...
2023-12-06 21:31:37 -05:00
Michael Chung
43b6808f23
Ok fixed docs and avaoilable weights endpoint
2023-12-06 20:05:23 -05:00
Michael Chung
330f24413d
added missing file
2023-12-06 19:54:21 -05:00
Michael Chung
af6370eea1
Issue with the api doc not sure.
2023-12-06 19:53:52 -05:00
Michael Chung
3a4ca7b548
weights doc complete.
2023-12-06 16:14:08 -05:00
Michael Chung
f7d5ad496c
Update docs
2023-12-06 14:01:31 -05:00
Brandon Thomas
8a6678c7f5
move workspace-hack under crates/
2023-12-06 02:12:57 -05:00
Michael Chung
f76928d001
Delete weight documentation added
2023-12-06 01:28:54 -05:00
Michael Chung
32cfb10323
added weights list documentation
2023-12-06 00:55:28 -05:00
Brandon Thomas
d9b1c8c36b
Merge pull request #192 from storytold/brandon-upgrade-chrono-vendored-limitation
...
upgrade chrono with vendored limitation
2023-12-05 21:54:36 -05:00
Brandon Thomas
fc122cb996
upgrade chrono with vendored limitation
2023-12-05 21:54:06 -05:00
Michael Chung
08d3c389b9
Merge branch 'master' into feature/weights_endpoints
2023-12-05 21:48:14 -05:00
Michael Chung
1a3b02b5d2
Adding docs
2023-12-05 21:46:53 -05:00
Brandon Thomas
e0e85fed5f
Merge pull request #191 from storytold/brandon-vendor-limitation
...
vendor `limitation` crate
2023-12-05 20:58:27 -05:00
Brandon Thomas
092745166e
vendor limitation crate
...
The limitation crate is four years old, stuck at 0.1.1. It looks unlikey
to be updated by the maintainer.
Upgrades to chrono and other libraries have broken limitation, so we're
likely now on the hook for maintaining this.
2023-12-05 20:56:22 -05:00
Michael Chung
024b4d769c
Merge branch 'master' into feature/weights_endpoints
2023-12-05 20:41:44 -05:00
Brandon Thomas
ea859bfc1e
Merge pull request #190 from storytold/brandon-revert-chrono-upgrade
...
Revert "Bump chrono from 0.4.22 to 0.4.31"
2023-12-05 20:40:37 -05:00
Brandon Thomas
92e0b1e9f4
Revert "Bump chrono from 0.4.22 to 0.4.31"
...
This reverts commit 4856ac28aa .
2023-12-05 20:40:09 -05:00
ArEnSc
d52d3f993a
Merge pull request #189 from storytold/feature/api-spec
...
Feature/api spec
2023-12-05 20:27:57 -05:00
Michael Chung
0033af73ce
Feedback addressed!
2023-12-05 20:26:07 -05:00
Brandon Thomas
514f80b884
Merge pull request #184 from storytold/dependabot/cargo/rustix-0.38.26
...
Bump rustix from 0.38.25 to 0.38.26
2023-12-05 19:22:24 -05:00
Brandon Thomas
74c548c02f
Merge pull request #182 from storytold/dependabot/cargo/chrono-0.4.31
...
Bump chrono from 0.4.22 to 0.4.31
2023-12-05 19:21:53 -05:00
Brandon Thomas
5fe09a182f
Merge pull request #185 from storytold/dependabot/cargo/lettre-0.11.2
...
Bump lettre from 0.11.1 to 0.11.2
2023-12-05 19:21:40 -05:00
dependabot[bot]
4856ac28aa
Bump chrono from 0.4.22 to 0.4.31
...
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.22 to 0.4.31.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/main/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.22...v0.4.31 )
---
updated-dependencies:
- dependency-name: chrono
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-06 00:19:36 +00:00
Brandon Thomas
404853e129
cleanup misleading old comment
2023-12-05 19:16:55 -05:00
Michael Chung
b5fcc3cdfa
Added documentation about the documentation
2023-12-05 19:14:02 -05:00
Brandon Thomas
300ac56ab7
Merge pull request #188 from storytold/brandon-media-files-global-list-fixed
...
global list of media files
2023-12-05 19:11:20 -05:00
Brandon Thomas
e32f8094e5
global list of media files
2023-12-05 19:09:42 -05:00
Michael Chung
e986a44e9d
documentation system open api spec.
2023-12-05 19:00:44 -05:00
Brandon Thomas
642e17a77d
Merge pull request #187 from storytold/brandon-fix-sqlx-query-builder
...
Fix QueryBuilder with respect to column names and type juggling
2023-12-05 18:31:13 -05:00
Brandon Thomas
36f3003576
Fix QueryBuilder with respect to column names and type juggling
2023-12-05 18:30:26 -05:00
Michael Chung
4993410740
Built needs a simple endpoint query test
2023-12-05 14:54:32 -05:00
Michael Chung
f99b5a92b8
Added weights paging to michael's spec missing the fields.
2023-12-05 13:44:50 -05:00
Brandon Thomas
b9f604dd18
reusable pagination types
2023-12-04 23:11:41 -05:00
Michael Chung
130e0daa08
paging works correctly.
2023-12-04 22:49:33 -05:00
Brandon Thomas
e6f5ecb980
Merge pull request #186 from storytold/brandon-list-media-files-for-user
...
list media files for user
2023-12-04 22:02:53 -05:00
Brandon Thomas
2e3ff8a730
list media files for user
2023-12-04 21:59:39 -05:00
Michael Chung
cda690773f
Merge branch 'master' into feature/weights_endpoints
2023-12-04 18:26:24 -05:00
Michael Chung
91d0a1da8f
Tests pass again
2023-12-04 18:21:43 -05:00
Michael Chung
8c7b100150
Adding new seed then have to switch tests back.
2023-12-04 18:06:11 -05:00
dependabot[bot]
ac13be2900
Bump lettre from 0.11.1 to 0.11.2
...
Bumps [lettre](https://github.com/lettre/lettre ) from 0.11.1 to 0.11.2.
- [Release notes](https://github.com/lettre/lettre/releases )
- [Changelog](https://github.com/lettre/lettre/blob/master/CHANGELOG.md )
- [Commits](https://github.com/lettre/lettre/compare/v0.11.1...v0.11.2 )
---
updated-dependencies:
- dependency-name: lettre
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-04 22:30:26 +00:00
dependabot[bot]
b55435d992
Bump rustix from 0.38.25 to 0.38.26
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.38.25 to 0.38.26.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.38.25...v0.38.26 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-04 22:30:06 +00:00
Brandon Thomas
28770ef736
fix query issue
2023-12-04 05:00:46 -05:00
Michael Chung
ae5eea53fe
Something wrong with the query parameters not passing off the limits etc
2023-12-04 03:57:40 -05:00
Brandon Thomas
894084fba6
Merge pull request #181 from storytold/brandon-queue-controls
...
Kill inference jobs (mod endpoint)
2023-12-04 03:54:05 -05:00
Brandon Thomas
4bf1a25fbb
Kill inference jobs (mod endpoint)
2023-12-04 03:46:29 -05:00
Michael Chung
241f648baf
Add type filtering in there and category filtering
2023-12-04 03:38:51 -05:00
Michael Chung
e4756a4f2c
Added more data seeding to the database for the model_weights table.
2023-12-04 01:52:14 -05:00
Michael Chung
9c8ee8dbbb
Ok list_weights_by_user works properly now.
2023-12-03 22:55:56 -05:00
Michael Chung
8072d13596
Fixed Delete and Updates for Weights
2023-12-03 01:35:04 -05:00
Michael Chung
1d937ab981
Initial weights_endpoints need testing right now.
2023-12-01 15:22:32 -05:00
Brandon Thomas
b0a9342194
updated queue stats
2023-12-01 07:09:23 -05:00
Brandon Thomas
3cc1ea6935
capture stderr for svc and rvc
2023-12-01 01:36:33 -05:00
Michael Chung
496ccd68f1
Working on uploads gonna be testing the endpoints soon.
...
Need a ui for the upload page to understand how to write it but it's similar to prior art just need to check that out.
2023-11-30 23:05:02 -05:00
Brandon Thomas
b74cf7853d
fix web break
2023-11-30 22:46:35 -05:00
Michael Chung
72fdd75568
added upload weights / create weight endpoint
...
original file for the weights
weights file type for safetensors or checkpoint
Gotta add one more thing for record creation
2023-11-30 17:33:25 -05:00
Brandon Thomas
3cdce86162
warn on slow batch queries
2023-11-30 17:25:23 -05:00
Brandon Thomas
b0a87e83a0
log batch index
2023-11-30 17:19:23 -05:00
Brandon Thomas
979c234ed2
cleanup logging
2023-11-30 16:27:25 -05:00
Brandon Thomas
4837106d37
distinguish logs
2023-11-30 16:10:01 -05:00
Brandon Thomas
cfd92e814d
Merge pull request #166 from storytold/dependabot/cargo/env_logger-0.10.1
...
Bump env_logger from 0.7.1 to 0.10.1
2023-11-30 16:02:23 -05:00
Brandon Thomas
6d27214a14
codegen
2023-11-30 15:50:05 -05:00
Brandon Thomas
b628fb0a11
premium TTS duration
2023-11-30 15:21:07 -05:00
dependabot[bot]
456b9e1ce6
Bump env_logger from 0.7.1 to 0.10.1
...
Bumps [env_logger](https://github.com/rust-cli/env_logger ) from 0.7.1 to 0.10.1.
- [Release notes](https://github.com/rust-cli/env_logger/releases )
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md )
- [Commits](https://github.com/rust-cli/env_logger/compare/v0.7.1...v0.10.1 )
---
updated-dependencies:
- dependency-name: env_logger
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-30 09:35:18 +00:00
Brandon Thomas
6f7b6da595
Merge pull request #167 from storytold/dependabot/cargo/rand-0.8.5
...
Bump rand from 0.7.3 to 0.8.5
2023-11-30 04:33:54 -05:00
Brandon Thomas
18ad28135f
safe delete
2023-11-30 02:36:33 -05:00
Brandon Thomas
ff4a3115d2
clear up more directories when file system is full
2023-11-30 02:34:33 -05:00
dependabot[bot]
ccae943037
Bump rand from 0.7.3 to 0.8.5
...
Bumps [rand](https://github.com/rust-random/rand ) from 0.7.3 to 0.8.5.
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-random/rand/compare/0.7.3...0.8.5 )
---
updated-dependencies:
- dependency-name: rand
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-30 07:32:36 +00:00
Brandon Thomas
12ef105ced
fix errors
2023-11-30 02:27:08 -05:00
Brandon Thomas
b27070e23e
get rid of more of container_common
2023-11-30 02:25:16 -05:00
Brandon Thomas
8e45a4ea45
delete mod
2023-11-30 02:05:15 -05:00
Brandon Thomas
a669ac7f03
move remaining container_common::files -> filesys crate
2023-11-30 02:04:41 -05:00
Brandon Thomas
b5ed9acdd4
move check_directory_exists to filesys crate
2023-11-30 01:56:55 -05:00
Brandon Thomas
ff2aaa9f3d
move check_file_exists to filesys crate
2023-11-30 01:53:42 -05:00
Brandon Thomas
f93421eadc
keep IoError around; better casting
2023-11-30 01:35:48 -05:00
Brandon Thomas
b82ffcce86
much more StorageFull error !
2023-11-30 01:26:03 -05:00
Brandon Thomas
e2c5839d01
surface storage full errors
2023-11-30 01:05:26 -05:00
Michael Chung
fba7d2a1eb
needs some tests for users and query builds with pagination
2023-11-30 00:48:54 -05:00
Michael Chung
347fe685cd
List list_availible_weights needs testing but is written.
2023-11-29 23:11:47 -05:00
Brandon Thomas
896e8591ba
cleanup
2023-11-29 23:10:15 -05:00
Brandon Thomas
19dcfdc629
cleanup
2023-11-29 22:51:12 -05:00
Brandon Thomas
cec7bce450
try copy instead
2023-11-29 22:49:00 -05:00
Brandon Thomas
6cc3062da8
don't fail if file is gone (not sure why this happens)
2023-11-29 22:01:53 -05:00
Brandon Thomas
efdd03bbbd
logging
2023-11-29 21:50:30 -05:00
Michael Chung
32331f9890
compiles working on list queries
2023-11-29 21:46:42 -05:00
Brandon Thomas
c207356ac5
cleanup retry
2023-11-29 21:44:20 -05:00
Brandon Thomas
3243cc51b7
try to delete and re-copy
2023-11-29 21:36:47 -05:00
Brandon Thomas
ee4af2976f
flag to permit cold filesystem cache
2023-11-29 21:26:03 -05:00
Brandon Thomas
4fb2a38c68
report temp file size
2023-11-29 21:10:01 -05:00
Brandon Thomas
a549ceb609
check vocoder and synthesizer sizes
2023-11-29 20:53:00 -05:00
Brandon Thomas
003f0cdeea
struct args for downloader (safer)
2023-11-29 20:46:33 -05:00
Brandon Thomas
9e0772141a
download file size check and logging
2023-11-29 20:25:37 -05:00
Brandon Thomas
542b79dd90
log http errors
2023-11-29 19:49:52 -05:00
Brandon Thomas
363f8cbc96
debug log statements, FileCacheDir (not yet used)
2023-11-29 19:28:32 -05:00
Brandon Thomas
f2e75f8637
rename files across fs devices
2023-11-29 18:46:00 -05:00
Brandon Thomas
f48cbb7978
fix
2023-11-29 18:16:45 -05:00
Brandon Thomas
edd5cd6156
Merge pull request #179 from storytold/brandon-fix-job-pathing
...
Brandon fix job pathing
2023-11-29 17:49:39 -05:00
Brandon Thomas
37c016cecb
"semi persistent dir" needs cleanup, this is confusing
2023-11-29 17:48:29 -05:00
Brandon Thomas
1a3e111dd6
Fix job pathing for outage and to make easier to manage
2023-11-29 17:30:03 -05:00
Michael Chung
65d6f178bc
WIP - weights endpoints need to be tested
...
Update weights endpoints had to be fixed.
should be ready to unit test the 3 endpoints before using the list weights
2023-11-29 17:07:18 -05:00
Brandon Thomas
0c456d957c
fix build errors
2023-11-29 15:46:43 -05:00
Brandon Thomas
85ecce7b38
comments
2023-11-29 03:07:07 -05:00
Brandon Thomas
2f1d682438
Merge pull request #176 from storytold/nov-29-mithoo
...
fail model deleted inference jobs
2023-11-29 02:44:38 -05:00
Brandon Thomas
c6fbfaa6ba
fix test failures and nits
2023-11-29 02:43:31 -05:00
Brandon Thomas
038401bff4
Merge pull request #177 from storytold/brandon-revert-sha2-bump
...
Revert "Bump sha2 from 0.9.9 to 0.10.8"
2023-11-29 02:29:16 -05:00
Brandon Thomas
e1c7231d96
Revert "Bump sha2 from 0.9.9 to 0.10.8"
...
This reverts commit 951afc2e5d .
2023-11-29 02:28:51 -05:00
kasisnu
1e11fdb35d
fail model deleted inference jobs
2023-11-29 12:43:49 +05:30
Brandon Thomas
74c477b045
Merge pull request #169 from storytold/dependabot/cargo/sha2-0.10.8
...
Bump sha2 from 0.9.9 to 0.10.8
2023-11-28 21:37:50 -05:00
Brandon Thomas
042fa1574d
Merge pull request #168 from storytold/dependabot/cargo/time-0.3.30
...
Bump time from 0.2.27 to 0.3.30
2023-11-28 21:37:26 -05:00
Brandon Thomas
4387e6326f
LFU cache in TT2 inference-job
2023-11-28 17:47:46 -05:00
Michael Chung
d9d166e500
Run routes using open api spec
2023-11-28 17:27:32 -05:00
Brandon Thomas
3ad2b744b7
test comment out Dockerfile /etc/ssl copy
2023-11-28 15:42:24 -05:00
Brandon Thomas
8bf85b637b
notes on dependencies
2023-11-28 15:40:26 -05:00
Brandon Thomas
50c3b5ed65
codegen db
2023-11-28 15:23:43 -05:00
Brandon Thomas
df15395bf7
fix build error
2023-11-28 15:08:39 -05:00
Brandon Thomas
5666d58da0
fix SSL problem?
2023-11-28 14:54:53 -05:00
dependabot[bot]
0a85e9c581
Bump time from 0.2.27 to 0.3.30
...
Bumps [time](https://github.com/time-rs/time ) from 0.2.27 to 0.3.30.
- [Release notes](https://github.com/time-rs/time/releases )
- [Changelog](https://github.com/time-rs/time/blob/main/CHANGELOG.md )
- [Commits](https://github.com/time-rs/time/compare/v0.2.27...v0.3.30 )
---
updated-dependencies:
- dependency-name: time
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-28 16:45:21 +00:00
ArEnSc
bd0ce25d94
Merge pull request #151 from storytold/feature/weights_queries
...
Feature/weights queries
2023-11-28 11:43:00 -05:00
ArEnSc
9f2335bfba
Merge branch 'master' into feature/weights_queries
2023-11-28 11:30:22 -05:00
Brandon Thomas
63eca62f1d
ssl to GCS broken in production, maybe this fixes?
2023-11-28 11:01:36 -05:00
Brandon Thomas
2808d20a35
fix wrong cleanup
2023-11-28 08:43:00 -05:00
Brandon Thomas
2d67947479
comment
2023-11-28 08:39:54 -05:00
Brandon Thomas
9722a34c8b
extra care to delete temp directories
2023-11-28 08:37:08 -05:00
Brandon Thomas
643dffc08c
scoped TempDir
2023-11-28 08:23:43 -05:00
Brandon Thomas
1433eca29a
queue stats for inference-job's tacotron2
2023-11-28 07:27:26 -05:00
Brandon Thomas
8176f0d6bd
fix lints
2023-11-28 06:26:17 -05:00
Brandon Thomas
2cfcbf8a75
db codegen + fix build errors
2023-11-28 06:19:37 -05:00
Brandon Thomas
fb9a9b75bf
Merge pull request #171 from storytold/brandon-tts-on-inference-job
...
tts-inference-job --> inference-job
2023-11-28 05:51:58 -05:00
Brandon Thomas
2a1675d865
formatting
2023-11-28 05:42:50 -05:00
Brandon Thomas
f672df7386
add TT2 HTTP sidecar health checking (hacky)
2023-11-28 05:11:43 -05:00
Brandon Thomas
59fc891ce4
filter out certain model types (so we don't leak to competitors)
2023-11-28 02:59:01 -05:00
Brandon Thomas
739f234ac3
emulate TTS Results in media file pages
2023-11-28 02:42:55 -05:00
Michael Chung
8303066c38
Added serial test to run the database tests in serial, prevent failing when running the suite.
2023-11-28 00:16:44 -05:00
Michael Chung
5feb500b5e
unit test for paging
2023-11-27 23:16:43 -05:00
Brandon Thomas
626157b615
emulate TTS inference job status checking for generic jobs
2023-11-27 22:19:27 -05:00
Brandon Thomas
7f3ccdc53d
cleanup dependency checking
2023-11-27 21:22:27 -05:00
Brandon Thomas
cc1d7f6de1
theoretically TTS HTTP works with inference-job
2023-11-27 20:55:13 -05:00
Brandon Thomas
3d4a870190
streamline inference-job tt2
2023-11-27 20:55:13 -05:00
Brandon Thomas
824d113dfc
port some dependencies of tts-inference-job to inference-job
2023-11-27 20:55:13 -05:00
Brandon Thomas
eaadc8242d
remove (unused) tts-inference-job shell out code
2023-11-27 20:55:13 -05:00
Brandon Thomas
bf5dddf6a9
Merge pull request #170 from storytold/brandon-seed-tt2-models
...
seed tool: TT2 models (with idempotency + early exit)
2023-11-27 20:50:31 -05:00
Brandon Thomas
22051f2dba
make idempotent
2023-11-27 20:42:37 -05:00
Brandon Thomas
d777346520
Update seed tool to seed TT2 models
2023-11-27 18:31:42 -05:00
dependabot[bot]
951afc2e5d
Bump sha2 from 0.9.9 to 0.10.8
...
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.9.9 to 0.10.8.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.9...sha2-v0.10.8 )
---
updated-dependencies:
- dependency-name: sha2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-27 22:32:08 +00:00
Michael Chung
d990fd4bfa
Merge branch 'feature/weights_queries' of https://github.com/storytold/storyteller-rust into feature/weights_queries
2023-11-27 12:12:02 -05:00
Michael Chung
6f5edf0c96
fixed issues with weights queries and the tests, tests slightly flaky need to have it delete the rows, and ensure it doesn't run in prod.
2023-11-27 12:09:34 -05:00
ArEnSc
b99756a7d1
Merge pull request #165 from storytold/nov-27-mithoo
...
query builder quickfix
2023-11-27 11:23:13 -05:00
kasisnu
dcbdaf9cd6
query builder quickfix
2023-11-27 17:47:55 +05:30
Michael Chung
8e4f419091
QiueryBuilder tests needed
2023-11-27 00:46:46 -05:00
Michael Chung
b779946fe7
Queries pass need just some mock data to test it in the test.rs
2023-11-26 15:29:57 -05:00
Michael Chung
a244e614cf
need to run tests on the query builder then can work on the rest of the code
2023-11-26 14:22:42 -05:00
Michael Chung
2e6708168b
building wip ... then test then endpoints probably need seed data for this that is a bit diverse.
2023-11-25 03:53:19 -05:00
Michael Chung
8c46f47352
queries building is wip.
2023-11-25 03:28:34 -05:00
Michael Chung
fdbf028743
test works query builder now.
2023-11-25 02:40:46 -05:00
Michael Chung
becf58a357
Time to test.
2023-11-25 01:51:02 -05:00
Michael Chung
a4c227a4ca
Fixes to the weights now need filter
2023-11-25 01:40:54 -05:00
Michael Chung
0e1e8a87f1
Mapping list_weights_by_user.rs done need filter and then test
2023-11-25 00:17:58 -05:00
Michael Chung
c9df278d40
weights_queries list weights by user more testing and implementation needed
2023-11-24 23:50:50 -05:00
Michael Chung
ddb35c5133
Added more data for seeding
...
Added to test lists need to get list_weights_by_user tested
2023-11-24 22:24:34 -05:00
Michael Chung
df3fc1bf51
more tests undelete and delete.
2023-11-24 00:35:43 -05:00
Michael Chung
21f2c3ac78
fixed weights queries get_weight hardcode transform
2023-11-24 00:19:21 -05:00
Michael Chung
be429017eb
Deleting weights from the database works for user
2023-11-23 23:34:14 -05:00
Michael Chung
2a623bd8eb
Ok just mapped this by hand, super dissapointed that I can't use the the proper way to do it for some unknown reason.
2023-11-23 22:46:28 -05:00
Michael Chung
8b2765ba65
Weight types is failing to serialize :S
2023-11-23 21:39:42 -05:00
Michael Chung
ccf1adae61
Add a test mod
2023-11-23 21:22:23 -05:00
Michael Chung
1a144ac8cf
Writing unit tests for the queries
2023-11-23 19:41:33 -05:00
Brandon Thomas
71581978ff
Merge pull request #162 from storytold/nov-21-mithoo
...
Bump actix & futures deps
2023-11-23 12:49:39 -05:00
Michael Chung
ce3aa6be74
model_weights delete need tests
2023-11-23 01:09:17 -05:00
Michael Chung
f63eb94ed7
update_weight needs testing
2023-11-23 00:46:11 -05:00
kasisnu
a987ae81cf
rebase codegen updates
2023-11-23 11:10:57 +05:30
kasisnu
684cd7df69
upgrade futures
2023-11-23 11:08:29 +05:30
kasisnu
703e297b94
easy bump actix deps
2023-11-23 11:08:29 +05:30
Michael Chung
2e4e109065
Notes
2023-11-22 23:41:16 -05:00
Michael Chung
8481d37167
Fixed compile errors.
2023-11-22 23:25:19 -05:00
Michael Chung
5ed397af4e
WIP get and update gotta write unit tests, WIP do not review.
2023-11-22 23:05:25 -05:00
Michael Chung
ccbc89fd3e
Fix function name issues
2023-11-22 13:21:52 -05:00
Brandon Thomas
62ce6d5991
codegen db
2023-11-22 03:07:13 -05:00
Brandon Thomas
e27871bd7e
Mark everything about BucketPathUnifier as deprecated. It sucks.
2023-11-22 02:27:48 -05:00
Brandon Thomas
106e3badc1
Merge pull request #163 from storytold/brandon-inference-job-startup-cleanup
...
Scoped inference jobs shouldn't require all parameters
2023-11-22 02:21:55 -05:00
Brandon Thomas
bcc91080e6
reorganize dependencies
2023-11-22 02:20:11 -05:00
Brandon Thomas
9848688a69
make container startup easier to parse
2023-11-21 22:45:04 -05:00
Brandon Thomas
5e2f85964c
vits dependencies
2023-11-21 22:18:32 -05:00
Brandon Thomas
8c17cd4415
vall-e-x dependencies
2023-11-21 21:54:32 -05:00
Brandon Thomas
58ce32dcbb
tacotron2
2023-11-21 21:45:55 -05:00
Brandon Thomas
2856be7aa9
SadTalker dependencies
2023-11-21 21:34:32 -05:00
Brandon Thomas
a28ef00618
cleanup job stubs we never implemented
2023-11-21 21:24:18 -05:00
Brandon Thomas
4941278590
SVC simplification
2023-11-21 20:06:33 -05:00
Michael Chung
5893753e35
Weights operations
2023-11-21 19:34:26 -05:00
Brandon Thomas
31ee410ac0
Cleanup Inference Job startup
...
- Don't require all env vars for all job types
2023-11-21 18:47:24 -05:00
Brandon Thomas
c256b14fe5
Merge pull request #158 from storytold/dependabot/cargo/tempfile-3.8.1
...
Bump tempfile from 3.3.0 to 3.8.1
2023-11-21 18:07:46 -05:00
Brandon Thomas
a2bd688ec2
Merge pull request #150 from storytold/dependabot/cargo/rustix-0.37.27
...
Bump rustix from 0.37.13 to 0.37.27
2023-11-21 18:07:20 -05:00
Brandon Thomas
2410be28c1
Merge pull request #159 from storytold/dependabot/cargo/num-traits-0.2.17
...
Bump num-traits from 0.2.15 to 0.2.17
2023-11-21 18:07:00 -05:00
Brandon Thomas
a1191aa2c3
Merge pull request #95 from storytold/oct-12-mithoo
...
super basic favorites impl
2023-11-21 18:03:58 -05:00
Brandon Thomas
2c502359a4
user favorites, entity favorites, etc. + minor changes
2023-11-21 18:02:32 -05:00
kasisnu
18bd819da2
zsvoice & VC models can be favorited
2023-11-21 14:59:28 -05:00
kasisnu
2614ba5eb9
remove ip address fields, and be able to favorite media files
2023-11-21 14:59:28 -05:00
kasisnu
b2bdf16c1c
update postman collection w/favoritesc
2023-11-21 14:59:27 -05:00
kasisnu
b436b07955
super basic favorites impl
2023-11-21 14:59:27 -05:00
Brandon Thomas
5da5908bea
Merge pull request #109 from storytold/oct-19-mithoo
...
delete media files/basic update handler
2023-11-21 13:24:22 -05:00
Brandon Thomas
58ea502400
Delete/update tweaks
2023-11-21 13:22:59 -05:00
kasisnu
3ed1f36e36
rebase updates with sqlx codegen
2023-11-21 13:14:43 -05:00
kasisnu
f958667cc4
delete media files/basic update handler
2023-11-21 13:14:43 -05:00
Kasisnu
87202f3ba2
Merge pull request #161 from storytold/nov-21-mithoo
...
disable speedup experiments on main workflows
2023-11-21 18:38:22 +05:30
kasisnu
b59bdc1ed5
disable speedup experiments on main workflows
2023-11-21 18:37:54 +05:30
Kasisnu
b68c7f415f
Merge pull request #160 from storytold/nov-21-mithoo
...
add new workflow
2023-11-21 13:34:53 +05:30
kasisnu
a08ebffeba
add new workflow
2023-11-21 13:33:20 +05:30
dependabot[bot]
7893acce0f
Bump num-traits from 0.2.15 to 0.2.17
...
Bumps [num-traits](https://github.com/rust-num/num-traits ) from 0.2.15 to 0.2.17.
- [Changelog](https://github.com/rust-num/num-traits/blob/master/RELEASES.md )
- [Commits](https://github.com/rust-num/num-traits/compare/num-traits-0.2.15...num-traits-0.2.17 )
---
updated-dependencies:
- dependency-name: num-traits
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-20 22:34:28 +00:00
dependabot[bot]
5dd3f7bf20
Bump tempfile from 3.3.0 to 3.8.1
...
Bumps [tempfile](https://github.com/Stebalien/tempfile ) from 3.3.0 to 3.8.1.
- [Changelog](https://github.com/Stebalien/tempfile/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Stebalien/tempfile/commits )
---
updated-dependencies:
- dependency-name: tempfile
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-20 22:33:55 +00:00
Kasisnu
f8a3a3b721
Merge pull request #157 from storytold/nov-20-mithoo
...
gpu build: copy result bins from updated directories
2023-11-20 15:47:35 +05:30
kasisnu
5895dc0b1f
gpu build: copy result bins from updated directories
2023-11-20 15:47:15 +05:30
kasisnu
75e19113da
x86_64-unknown-linux-musl -> x86_64-unknown-linux-gnu
2023-11-20 15:38:14 +05:30
Kasisnu
a7dcdf19ed
Merge pull request #156 from storytold/nov-20-mithoo
...
add --target=x86_64-unknown-linux-musl explicitly
2023-11-20 15:27:56 +05:30
kasisnu
8e415770fb
Merge remote-tracking branch 'origin/master' into nov-20-mithoo
2023-11-20 15:26:46 +05:30
kasisnu
28d64f29e2
sadpanda
2023-11-20 15:26:17 +05:30
Kasisnu
9da6be3320
Merge pull request #155 from storytold/nov-20-mithoo
...
statically build gpu binaries
2023-11-20 15:20:28 +05:30
kasisnu
49cec49844
statically build gpu binaries
2023-11-20 15:19:27 +05:30
Brandon Thomas
a2354cd64c
install rsync in containers (lazy, fix this)
...
This was a lazy way to add rsync into the containers to enable easy
copying of files + logging. This is not the ideal way to do this.
2023-11-20 01:20:09 -05:00
Kasisnu
809dabd253
Merge pull request #154 from storytold/nov-20-mithoo
...
trailing slash
2023-11-20 11:22:11 +05:30
kasisnu
0470811bb4
trailing slash
2023-11-20 11:21:50 +05:30
Kasisnu
fecb671400
Merge pull request #153 from storytold/nov-20-mithoo
...
sqlx codegen
2023-11-20 11:12:50 +05:30
kasisnu
6d82cb9de6
updated dockerfiles for sqlx codegen
2023-11-20 11:11:44 +05:30
kasisnu
0fdacfe295
sqlx codegen
2023-11-20 10:55:43 +05:30
Brandon Thomas
6a255330b4
Merge pull request #152 from storytold/brandon-rustls
...
Switch from native TLS to rustls
2023-11-20 00:10:20 -05:00
Brandon Thomas
e64fcab028
Switch from native TLS to rustls
...
This should make for smaller and simpler binaries.
2023-11-20 00:06:15 -05:00
Michael Chung
6026748563
Seeding Weights probably actually need real weights
2023-11-19 23:36:59 -05:00
dependabot[bot]
6cd48d2f5b
Bump rustix from 0.37.13 to 0.37.27
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.37.13 to 0.37.27.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.37.13...v0.37.27 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-20 04:34:25 +00:00
Brandon Thomas
b36283c76e
Merge pull request #149 from storytold/brandon-upgrade-sqlx-0.7.2
...
Upgrade sqlx to latest (0.7.2)
2023-11-19 23:32:22 -05:00
Brandon Thomas
bd4644098f
Upgrade sqlx to latest (0.7.2)
...
Hypothetically this unblocks native rustls over IP address. If so, we
can drop native OpenSSL and Ubuntu packages and make a much simpler
build.
See this issue:
https://github.com/launchbadge/sqlx/issues/1095#issuecomment-798050828
Had to deal with a few migration issues,
- changes to transactor types:
https://github.com/launchbadge/sqlx/issues/2606
- changes to sqlx_core that impacted our serialization/deserialization macros
2023-11-19 23:25:52 -05:00
Brandon Thomas
831b0eda29
Don't need this - let's invert the pod in control
2023-11-18 23:47:52 -05:00
Michael Chung
bffe8d39ae
model_weights/create_weight.rs being worked on
2023-11-18 00:44:41 -05:00
Michael Chung
c36ca5e73c
create model_weights
2023-11-17 23:59:53 -05:00
Michael Chung
55344fc6dd
Model Weight Queries has to be worked on categories and types tests written.
2023-11-17 23:39:55 -05:00
Brandon Thomas
0a9803af83
PLEAAASE BUILD
2023-11-17 11:29:27 -05:00
Brandon Thomas
0952d16a86
-y flag ?
2023-11-17 11:08:43 -05:00
Brandon Thomas
2ed43572e0
maybe patch 3.8 logger too
2023-11-17 10:34:16 -05:00
Brandon Thomas
72e67ed198
really install deadsnakes
2023-11-17 10:21:18 -05:00
Brandon Thomas
66774b0d31
python3.8 (this should only be temporary)
2023-11-17 10:14:04 -05:00
Brandon Thomas
d54cd75dec
unblock route
2023-11-17 08:48:13 -05:00
Brandon Thomas
23293e973f
codegen db
2023-11-17 03:42:01 -05:00
Brandon Thomas
5bb32d0adb
record millis and encoding
2023-11-17 03:16:40 -05:00
Brandon Thomas
d123a73069
confirm email when password reset
2023-11-17 02:48:24 -05:00
Brandon Thomas
f978c1f4cc
propagate avt to zero shot tts
2023-11-17 02:39:55 -05:00
Brandon Thomas
9d38440ae4
rename handler
2023-11-17 01:52:10 -05:00
Brandon Thomas
4530083333
more foreign key and field completion for samples
2023-11-17 01:49:03 -05:00
Brandon Thomas
23584b4462
Merge pull request #148 from storytold/brandon-vallex-pathing
...
Fix vallex pathing
2023-11-16 21:03:50 -05:00
Brandon Thomas
762cf2d0b4
pathing works
2023-11-16 21:02:54 -05:00
Brandon Thomas
7a4c035960
upload of weights works
2023-11-16 20:32:19 -05:00
Brandon Thomas
cd8ca0092b
modify bucket pathing
2023-11-16 20:07:14 -05:00
Brandon Thomas
c920ae5286
Merge pull request #147 from storytold/bt-split-vallex-to-files
...
split vallex tts inference + embedding creation
2023-11-16 19:06:55 -05:00
Brandon Thomas
61bb4162a3
split vallex tts inference + embedding creation
2023-11-16 19:06:16 -05:00
Brandon Thomas
a1c7db19e3
Merge pull request #146 from storytold/bt-better-error-logging-vallex
...
better error logging, pathing
2023-11-16 18:53:41 -05:00
Brandon Thomas
e6690fa133
better error logging, pathing
2023-11-16 18:52:56 -05:00
Brandon Thomas
c22f7fe654
Merge pull request #138 from storytold/dependabot/cargo/magic-crypt-3.1.13
...
Bump magic-crypt from 3.1.8 to 3.1.13
2023-11-16 17:56:54 -05:00
Brandon Thomas
bc94582138
Merge pull request #140 from storytold/dependabot/cargo/strum-0.25.0
...
Bump strum from 0.24.1 to 0.25.0
2023-11-16 17:56:18 -05:00
Brandon Thomas
b3226b04cb
Merge pull request #139 from storytold/dependabot/cargo/serde_json-1.0.108
...
Bump serde_json from 1.0.91 to 1.0.108
2023-11-16 17:56:05 -05:00
Michael Chung
afc0e27fb4
Made updates to the seed and the docs to reflect the new seed files.
2023-11-16 16:07:50 -05:00
Brandon Thomas
f338d57ef5
Merge pull request #145 from storytold/bt-zs-inference-cleanup
...
voice designer inference job cleanup
2023-11-16 15:01:26 -05:00
Brandon Thomas
419c202ec9
voice designer inference job cleanup
...
- paths were different between upload, inference, and seed tool
- errors aren't being appropriately handled (and there's still work to
do here)
2023-11-16 05:10:30 -05:00
dependabot[bot]
59c19b2927
Bump strum from 0.24.1 to 0.25.0
...
Bumps [strum](https://github.com/Peternator7/strum ) from 0.24.1 to 0.25.0.
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Peternator7/strum/commits )
---
updated-dependencies:
- dependency-name: strum
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-16 06:18:28 +00:00
dependabot[bot]
3adf92d4e5
Bump serde_json from 1.0.91 to 1.0.108
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.91 to 1.0.108.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.91...v1.0.108 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-16 06:17:36 +00:00
Brandon Thomas
04e2605240
fixup lint / test failures
2023-11-16 01:16:09 -05:00
Brandon Thomas
6186dcd89d
analytics on password resets
2023-11-16 01:06:03 -05:00
Brandon Thomas
0f3586746e
committing secrets is a sin
2023-11-16 00:45:47 -05:00
Brandon Thomas
f84c31de5b
success response fields
2023-11-16 00:03:01 -05:00
Brandon Thomas
a19cafbae0
parameterize SMTP account
2023-11-15 23:55:34 -05:00
Brandon Thomas
b45afab5ea
stupid fix
2023-11-15 23:18:41 -05:00
Brandon Thomas
6d24b4b49b
codegen db
2023-11-15 22:47:20 -05:00
Brandon Thomas
f9704f0da4
Merge pull request #144 from storytold/brandon-email-job
...
email-job
2023-11-15 22:34:43 -05:00
Brandon Thomas
c7c7c5b798
email-job
2023-11-15 22:31:18 -05:00
Brandon Thomas
462ed87a7b
Merge pull request #132 from storytold/brandon-model-weights
...
WIP / DNM - model_weights
2023-11-15 21:03:02 -05:00
Brandon Thomas
170f6772d7
rename migrations for better operational sequencing
2023-11-15 21:02:11 -05:00
Brandon Thomas
2b884ebe51
Move metadata into polymorphic join tables
2023-11-15 21:00:41 -05:00
Brandon Thomas
fec587d81e
"model_weights" to replace all of the various weights tables
2023-11-15 21:00:39 -05:00
dependabot[bot]
4aec1a2298
Bump magic-crypt from 3.1.8 to 3.1.13
...
Bumps [magic-crypt](https://github.com/magiclen/rust-magiccrypt ) from 3.1.8 to 3.1.13.
- [Commits](https://github.com/magiclen/rust-magiccrypt/compare/v3.1.8...v3.1.13 )
---
updated-dependencies:
- dependency-name: magic-crypt
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-16 01:31:31 +00:00
Brandon Thomas
1e3117789e
Merge pull request #143 from storytold/nov-15-mithoo
...
build fix, get endpoints for zs datasets/voices
2023-11-15 20:30:11 -05:00
kasisnu
a18ebc4db3
get endpoints for zs datasets & voices
2023-11-15 14:26:57 +05:30
kasisnu
6cc75df103
Merge remote-tracking branch 'origin/speedup-experiments' into nov-15-mithoo
2023-11-15 11:19:45 +05:30
kasisnu
297ce4e0ad
add hakari dep to dockerfile
2023-11-14 12:46:43 +05:30
kasisnu
235c0d6754
fix missing deps
2023-11-14 12:42:28 +05:30
Kasisnu
8cd8f45b6c
Merge pull request #142 from storytold/nov-12-mithoo
...
removing some unused creates
2023-11-14 12:37:04 +05:30
kasisnu
ee0526f499
add a second branch to test speedups
2023-11-14 12:35:50 +05:30
kasisnu
d84e497131
hakari deps
2023-11-14 12:32:54 +05:30
kasisnu
2eb5635c58
removing some unused creates
2023-11-14 12:31:37 +05:30
Brandon Thomas
dd3c87b712
don't leak accounts
2023-11-12 07:02:39 -05:00
Brandon Thomas
7dc7afd244
environmental reset link
2023-11-12 05:16:53 -05:00
Brandon Thomas
f1d3566f30
login after password reset
2023-11-12 04:24:47 -05:00
Brandon Thomas
3852851f65
'success' fields, cleanup
2023-11-12 02:52:26 -05:00
Brandon Thomas
bdd24c47fa
codegen db
2023-11-12 02:36:29 -05:00
Brandon Thomas
a31a72abb7
Merge pull request #137 from storytold/brandon-jake-password-reset
...
password reset
2023-11-12 02:27:56 -05:00
Brandon Thomas
34c90becbb
schema migrations for password reset
2023-11-12 02:26:38 -05:00
Brandon Thomas
a69d0f7b9a
redemption works
2023-11-11 19:56:23 -05:00
Brandon Thomas
e068af0e1c
wip redemption
2023-11-11 16:23:30 -05:00
Brandon Thomas
c6a111bb4c
smtp wired up
2023-11-11 14:53:58 -05:00
Brandon Thomas
9ce771f571
fix crockford-encoded entropy
2023-11-10 16:27:30 -05:00
Jacob Conley
5892fb1f14
Fixed implementation up to the point of sending the email
2023-11-10 16:14:24 -05:00
Jacob Conley
6bbf8a9b01
Changed e-mail library; still only partially implemented
2023-11-10 16:14:21 -05:00
Jacob Conley
16d6542911
Beginning password reset implementation
...
- Email send is not implemented yet
- All of this is still untested, clearly
2023-11-10 16:13:58 -05:00
Jacob Conley
1cc3c5eee4
Update more crockford_deprecated stuff for real this time
2023-11-10 16:12:42 -05:00
Jacob Conley
054d7db0a9
Update crockford_deprecated references
2023-11-10 16:12:41 -05:00
Jacob Conley
927337331e
Rename crockford crate to crockford_deprecated - Gotta update references
2023-11-10 16:12:41 -05:00
Kasisnu
50780926fb
Merge pull request #136 from storytold/nov-10-mithoo
...
fix various stripe handler errors :(
2023-11-10 15:05:33 +05:30
kasisnu
2ebd6dc634
fix various stripe handler errors :(
2023-11-10 15:05:02 +05:30
Kasisnu
c5d5a4ba08
Merge pull request #135 from storytold/nov-10-mithoo
...
feat: report errors to stripe
2023-11-10 13:59:40 +05:30
kasisnu
797332b887
feat: report errors to stripe
2023-11-10 13:59:19 +05:30
Kasisnu
30d71ad605
Merge pull request #134 from storytold/nov-10-mithoo
...
audio mp4 uploads on ios
2023-11-10 13:47:15 +05:30
kasisnu
889121a818
audio mp4 uploads on ios
2023-11-10 13:46:39 +05:30
Brandon Thomas
293f531a79
Merge pull request #133 from storytold/lru-delete-models
...
Delete models from AWS EFS host
2023-11-10 00:36:21 -05:00
Brandon Thomas
fc344557be
Delete models from AWS EFS host
2023-11-10 00:35:36 -05:00
Brandon Thomas
a34785c308
Merge pull request #128 from storytold/dependabot/cargo/hyper-0.14.24
...
Bump hyper from 0.13.10 to 0.14.24
2023-11-09 13:44:41 -05:00
Brandon Thomas
7d6aec158c
Merge pull request #114 from storytold/dependabot/cargo/derive_more-0.99.17
...
Bump derive_more from 0.99.14 to 0.99.17
2023-11-09 13:42:14 -05:00
Brandon Thomas
861faafe60
Merge pull request #127 from storytold/dependabot/cargo/subprocess-0.2.9
...
Bump subprocess from 0.2.7 to 0.2.9
2023-11-09 13:42:05 -05:00
Brandon Thomas
5240d3cde5
Merge pull request #129 from storytold/dependabot/cargo/futures-util-0.3.29
...
Bump futures-util from 0.3.28 to 0.3.29
2023-11-09 13:41:56 -05:00
Brandon Thomas
8b962dcf6d
notes on vocoder_models table
2023-11-09 00:45:30 -05:00
dependabot[bot]
e2c3aedfb8
Bump hyper from 0.13.10 to 0.14.24
...
Bumps [hyper](https://github.com/hyperium/hyper ) from 0.13.10 to 0.14.24.
- [Release notes](https://github.com/hyperium/hyper/releases )
- [Changelog](https://github.com/hyperium/hyper/blob/v0.14.24/CHANGELOG.md )
- [Commits](https://github.com/hyperium/hyper/compare/v0.13.10...v0.14.24 )
---
updated-dependencies:
- dependency-name: hyper
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-08 17:31:45 +00:00
dependabot[bot]
e9605ea6af
Bump futures-util from 0.3.28 to 0.3.29
...
Bumps [futures-util](https://github.com/rust-lang/futures-rs ) from 0.3.28 to 0.3.29.
- [Release notes](https://github.com/rust-lang/futures-rs/releases )
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.28...0.3.29 )
---
updated-dependencies:
- dependency-name: futures-util
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-08 17:31:22 +00:00
Brandon Thomas
c6c708827b
Merge pull request #131 from storytold/nov-08-mithoo
...
bump async-stripe, dealing with webhook handler failures/updates
2023-11-08 12:29:03 -05:00
kasisnu
c9b3ce06d6
bump async-stripe, dealing with webhook handler failures/updates
2023-11-08 15:17:06 +05:30
Kasisnu
e4faf58990
Merge pull request #130 from storytold/nov-08-mithoo
...
iphone audio mimetype
2023-11-08 12:08:58 +05:30
kasisnu
d77c5e1885
iphone audio mimetype
2023-11-08 12:08:17 +05:30
Brandon Thomas
4930629a3a
fix lint and test failures
2023-11-07 22:33:38 -05:00
Brandon Thomas
331a0ce518
codegen db
2023-11-07 21:55:31 -05:00
Brandon Thomas
7aaa70bb31
more voice takedowns
2023-11-07 21:41:02 -05:00
Brandon Thomas
81d54291d1
Add README notes for Mac; streamline README
2023-11-02 01:14:48 -04:00
Brandon Thomas
77a2cc3439
dynamically flag off voice designer in production
2023-11-01 05:47:59 -04:00
Brandon Thomas
2882128a5c
todo
2023-11-01 04:38:06 -04:00
Brandon Thomas
0150715d63
setup for Windows Subsystem for Linux
2023-11-01 02:38:08 -04:00
Brandon Thomas
d63f5a8728
reorganize readme
2023-10-31 22:49:23 -04:00
dependabot[bot]
dcd77e53aa
Bump subprocess from 0.2.7 to 0.2.9
...
Bumps [subprocess](https://github.com/hniksic/rust-subprocess ) from 0.2.7 to 0.2.9.
- [Commits](https://github.com/hniksic/rust-subprocess/compare/release/0.2.7...release/0.2.9 )
---
updated-dependencies:
- dependency-name: subprocess
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-30 23:12:08 +00:00
Brandon Thomas
10ce570aa9
Merge pull request #126 from storytold/brandon-zs-endpoint-refinement
...
Brandon zs endpoint refinement
2023-10-30 18:29:43 -04:00
Brandon Thomas
fa3244c72b
fix iPhone audio/mp4 bug
2023-10-30 15:12:42 -04:00
Brandon Thomas
7a6a3840c3
return more fields on "list all voices"
2023-10-30 04:26:39 -04:00
Brandon Thomas
30760e29d6
list datasets by session handler; more cleanup
2023-10-30 04:14:55 -04:00
Brandon Thomas
3c025c506e
add "list voices by session" endpoint; misc cleanup
2023-10-30 03:41:56 -04:00
Brandon Thomas
8dd5661923
remove more
2023-10-29 12:39:35 -04:00
Brandon Thomas
0bcdaa0d2d
missed one
2023-10-29 12:35:20 -04:00
Brandon Thomas
c5efc9e0c8
RVC takedown requests
2023-10-29 12:33:45 -04:00
Brandon Thomas
b8c85b7e91
minor tweak to threading
2023-10-28 20:52:30 -04:00
Brandon Thomas
29e556c311
rename with kebob-case
2023-10-28 20:27:02 -04:00
Brandon Thomas
dc735c01a0
rust 1.66 -> 1.73 (required update)
2023-10-27 06:13:06 -04:00
Brandon Thomas
7d66279d70
fix nits
2023-10-27 06:09:21 -04:00
Brandon Thomas
d6de7acc5c
codegen db
2023-10-27 05:58:34 -04:00
Brandon Thomas
5da6cee74c
Merge pull request #124 from storytold/brandon-elasticsearch
...
Introduce elasticsearch database + tools
2023-10-27 05:56:20 -04:00
Brandon Thomas
e4607fe658
Introduce elasticsearch database + tools
2023-10-27 05:56:00 -04:00
Brandon Thomas
4def45d769
Merge pull request #123 from storytold/brandon-revert-sha2-upgrade
...
Revert "Bump sha2 from 0.9.5 to 0.10.5"
2023-10-26 00:01:30 -04:00
Brandon Thomas
b6f7f50b16
Revert "Bump sha2 from 0.9.5 to 0.10.5"
...
This reverts commit b9667e2540 .
2023-10-25 23:52:40 -04:00
Brandon Thomas
8af1a2da47
Merge pull request #115 from storytold/dependabot/cargo/sha2-0.10.5
...
Bump sha2 from 0.9.5 to 0.10.5
2023-10-25 23:50:32 -04:00
dependabot[bot]
995c912e94
Bump derive_more from 0.99.14 to 0.99.17
...
Bumps [derive_more](https://github.com/JelteF/derive_more ) from 0.99.14 to 0.99.17.
- [Release notes](https://github.com/JelteF/derive_more/releases )
- [Changelog](https://github.com/JelteF/derive_more/blob/master/CHANGELOG.md )
- [Commits](https://github.com/JelteF/derive_more/compare/v0.99.14...v0.99.17 )
---
updated-dependencies:
- dependency-name: derive_more
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-26 03:50:14 +00:00
Brandon Thomas
c018001693
Merge pull request #116 from storytold/dependabot/cargo/pulldown-cmark-0.9.3
...
Bump pulldown-cmark from 0.8.0 to 0.9.3
2023-10-25 23:48:38 -04:00
Brandon Thomas
3f54396ef4
Merge pull request #118 from storytold/dependabot/cargo/actix-http-3.4.0
...
Bump actix-http from 3.3.0 to 3.4.0
2023-10-25 23:48:14 -04:00
Brandon Thomas
85eed593d0
Merge pull request #122 from storytold/voice-designer-concrete-types
...
more concrete types for "enum"-like fields, remove unnecessary updates
2023-10-25 23:47:21 -04:00
Brandon Thomas
50a0cb298d
more concrete types for "enum"-like fields, remove unnecessary updates
2023-10-25 23:39:42 -04:00
Brandon Thomas
b11ad51d8e
rename enum serialization
2023-10-25 17:01:17 -04:00
Brandon Thomas
b0aae47328
rename some IdCategory enum values (not serializations)
2023-10-25 16:58:45 -04:00
Brandon Thomas
a6c4c10a9a
fix tests and lints
2023-10-25 16:46:19 -04:00
ArEnSc
7b31887891
Merge pull request #94 from storytold/feature/enqueue_tts_request
...
Feature/enqueue tts request
2023-10-25 11:58:31 -04:00
Michael Chung
8a5e4538a0
All good! going to merge now.
2023-10-25 11:32:22 -04:00
Brandon Thomas
37129a6d01
better documentation
2023-10-25 04:04:51 -04:00
Brandon Thomas
7731c534a3
restructure tokens package to organize prefixes
...
Tests enforce the new style, which wasn't possible before
2023-10-25 03:57:19 -04:00
dependabot[bot]
b9667e2540
Bump sha2 from 0.9.5 to 0.10.5
...
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.9.5 to 0.10.5.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.5...sha2-v0.10.5 )
---
updated-dependencies:
- dependency-name: sha2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-25 07:03:42 +00:00
Brandon Thomas
9aeca4aa90
Finally 'Tokens::' methods are dead!
2023-10-25 03:02:14 -04:00
Brandon Thomas
f40a292b1e
todo
2023-10-25 00:59:27 -04:00
Brandon Thomas
d90df6f8b8
change billing token to typed token
2023-10-25 00:55:54 -04:00
Brandon Thomas
92c76d2bb9
get rid of more legacy tokens
2023-10-25 00:49:12 -04:00
Brandon Thomas
9b5bb16358
continue getting rid of Token in the mysql package
2023-10-25 00:14:11 -04:00
Brandon Thomas
03135fa781
investigate use of face animator
2023-10-24 23:48:13 -04:00
Michael Chung
3f70ca72dd
Dev environment
...
Fixed various code problems, going to merge soon.
2023-10-24 13:09:36 -04:00
Michael Chung
d8a4b6c735
Get everything to build again we have to merge soon.
2023-10-24 11:26:12 -04:00
Michael Chung
48ed6d118c
Merge issues with VSCode? this is strange ....
2023-10-24 11:15:31 -04:00
Michael Chung
4c3ac3edda
Merge branch 'master' into feature/enqueue_tts_request
2023-10-24 10:20:37 -04:00
Brandon Thomas
dae5764658
codegen queries
2023-10-24 05:40:33 -04:00
Brandon Thomas
98547df063
propagate avt from jobs to media_files
2023-10-24 05:12:42 -04:00
Brandon Thomas
9c856235fc
write avt cookie token to inference jobs
2023-10-24 05:04:00 -04:00
Brandon Thomas
205f6de1b2
fix lint failures
2023-10-24 04:20:38 -04:00
Brandon Thomas
a9fa45575e
additional comment
2023-10-24 04:07:02 -04:00
Brandon Thomas
1b77974a0e
change user token prefix
2023-10-24 04:06:33 -04:00
Brandon Thomas
724ae2570e
How did this ever work!?
2023-10-24 03:56:38 -04:00
Brandon Thomas
dc7b5b7e60
Merge pull request #120 from storytold/echelon-terminate-job-endpoint
...
endpoint to terminate jobs
2023-10-24 02:41:03 -04:00
Brandon Thomas
3259433717
endpoint to terminate jobs
2023-10-24 02:40:00 -04:00
Brandon Thomas
bc5d84a306
use the new job status enum
2023-10-24 01:22:48 -04:00
Brandon Thomas
2357f00944
Merge pull request #119 from storytold/echelon-job-system-new-states
...
Introduce two new job status types to generic inference jobs
2023-10-24 01:08:15 -04:00
Brandon Thomas
24127f20e4
Introduce two new job status types to generic inference jobs
2023-10-24 01:06:14 -04:00
Brandon Thomas
4c8f14d4d5
Migration to make password_resets.ip_address_redemption nullable
2023-10-23 22:11:26 -04:00
Brandon Thomas
e14440ba02
undo edit to previous migration (should be harmless in prod)
2023-10-23 22:05:11 -04:00
Michael Chung
7295a3295f
Fix prefixes for create and inference
2023-10-23 22:03:37 -04:00
Michael Chung
10176079c7
remove variables not used
2023-10-23 21:59:26 -04:00
Michael Chung
8999a80e92
Change root ml dir
2023-10-23 21:34:58 -04:00
Michael Chung
41b07049ff
Remove comments
2023-10-23 21:29:41 -04:00
Michael Chung
b45f6ed691
Restore storyteller rust root for dev_database_seed
2023-10-23 21:25:04 -04:00
Michael Chung
9d16eb05c1
Fix data seed env-secrets path.
2023-10-23 21:13:27 -04:00
Michael Chung
b414540251
Fixing issue with the origin model type along side tests.
2023-10-23 21:11:00 -04:00
Michael Chung
2949456adc
Restore bad merge on id_category.rs
2023-10-23 21:07:35 -04:00
dependabot[bot]
02d06df0e2
Bump actix-http from 3.3.0 to 3.4.0
...
Bumps [actix-http](https://github.com/actix/actix-web ) from 3.3.0 to 3.4.0.
- [Release notes](https://github.com/actix/actix-web/releases )
- [Changelog](https://github.com/actix/actix-web/blob/master/CHANGES.md )
- [Commits](https://github.com/actix/actix-web/compare/web-v3.3.0...http-v3.4.0 )
---
updated-dependencies:
- dependency-name: actix-http
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-23 22:31:41 +00:00
dependabot[bot]
b89ef1fe20
Bump pulldown-cmark from 0.8.0 to 0.9.3
...
Bumps [pulldown-cmark](https://github.com/raphlinus/pulldown-cmark ) from 0.8.0 to 0.9.3.
- [Release notes](https://github.com/raphlinus/pulldown-cmark/releases )
- [Commits](https://github.com/raphlinus/pulldown-cmark/compare/v0.8.0...v0.9.3 )
---
updated-dependencies:
- dependency-name: pulldown-cmark
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-23 22:30:59 +00:00
Michael Chung
3a72292898
Some minor comment fix
2023-10-23 16:54:27 -04:00
Michael Chung
07c640ce84
Retest the endpoints with the correct credentials
...
One more integration test with multiple wav files.
2023-10-23 16:52:31 -04:00
Michael Chung
49a15fd1f1
Cleaning up some of the end points.
2023-10-23 16:22:37 -04:00
Michael Chung
3267f9949d
Added ip address and creator token.
2023-10-23 16:02:07 -04:00
Michael Chung
47df6930d2
Basically works well!
...
Few things to checkout.
2023-10-22 23:38:31 -04:00
Michael Chung
913d282d60
Fixed extensions on create
...
Checking whether media uploads.
2023-10-22 20:52:57 -04:00
Michael Chung
743934ff50
Need to do a clean up then check media upload and table
2023-10-22 20:36:32 -04:00
Michael Chung
bc209fe939
So the prefix wasn't populated in the seed I think!
2023-10-22 17:57:35 -04:00
Michael Chung
302975ddfd
Seeded db testing again
2023-10-22 11:57:29 -04:00
Michael Chung
d7664e8e1c
Merge branch 'master' into feature/enqueue_tts_request
2023-10-21 02:41:43 -04:00
Michael Chung
9f7fc09e9f
Builds testing.
2023-10-21 01:13:39 -04:00
Michael Chung
2686cb94e0
Testing create command now.
2023-10-21 00:28:11 -04:00
Michael Chung
fd7f1e1893
testing now.
2023-10-20 23:27:31 -04:00
Brandon Thomas
eb3499596e
always output stderr
2023-10-20 14:45:03 -04:00
Michael Chung
00bfdad3d0
Test pass!
2023-10-20 12:13:57 -04:00
Michael Chung
ff3821956a
Builds again
2023-10-20 11:43:16 -04:00
Michael Chung
a5a5f5473b
Testing!
2023-10-20 10:13:23 -04:00
Brandon Thomas
7c553ffcee
fix rvc jobs
2023-10-20 07:00:09 -04:00
Brandon Thomas
52f0b44c26
codegen db
2023-10-20 06:14:49 -04:00
Brandon Thomas
fbed7cd530
Merge pull request #113 from storytold/echelon-voice-conversion-media-files
...
voice conversion --> media files
2023-10-20 06:14:19 -04:00
Brandon Thomas
4ce8752a6a
codegen db
2023-10-20 06:12:41 -04:00
Brandon Thomas
3239e318b1
fix inference job status links
2023-10-20 05:37:51 -04:00
Brandon Thomas
471dcff697
RVC -> media_files
2023-10-20 05:14:00 -04:00
Brandon Thomas
2af57fcf3e
Write voice conversion results to media_files tables
2023-10-20 05:14:00 -04:00
Brandon Thomas
f2b0e77210
fix stupid "1" bug on generic jobs
2023-10-20 05:13:44 -04:00
Michael Chung
10c8bc1ef3
Just need to run inference and pass the insert the record and upload the voice once it infers.
...
Run the path test.
2023-10-20 01:46:13 -04:00
Brandon Thomas
35dfe6a7f2
fix lints
2023-10-20 01:09:56 -04:00
Brandon Thomas
48ecc44978
Merge pull request #112 from storytold/echelon-seed-samples
...
Update seed tool to seed and upload samples
2023-10-19 22:36:30 -04:00
Brandon Thomas
4f0e2d5f72
Update seed tool to seed and upload samples
2023-10-19 22:33:24 -04:00
Brandon Thomas
96c99fd102
Merge pull request #111 from storytold/echelon-media-file-upload-cli
...
CLI tool to upload media files and save them to the DB
2023-10-19 21:56:38 -04:00
Brandon Thomas
26794b3d2e
CLI tool to upload media files and save them to the DB
2023-10-19 21:52:32 -04:00
Michael Chung
c3a60ed8ab
Merge branch 'master' into feature/enqueue_tts_request
2023-10-19 20:12:40 -04:00
Michael Chung
13964901f0
update process job created a fork for creating voice
2023-10-19 19:19:53 -04:00
Brandon Thomas
593fb50fcb
Merge pull request #110 from storytold/echelon-list-dataset-samples
...
Enrich list dataset samples query + endpoint with bucket information
2023-10-19 18:24:39 -04:00
Brandon Thomas
fff71d7aa4
Enrich list dataset samples query + endpoint with bucket information
2023-10-19 18:18:35 -04:00
Michael Chung
57eecb3757
Creating the create voice job
2023-10-19 16:26:43 -04:00
Brandon Thomas
022aa523cb
fix cookie paths ?
2023-10-19 05:56:15 -04:00
Brandon Thomas
6d01506bd1
fix cookie path
2023-10-19 05:53:44 -04:00
Brandon Thomas
0cc3baee27
Merge pull request #108 from storytold/brandon-set-avt-cookie
...
Start setting AVT cookie on /v1/session endpoint
2023-10-19 05:06:00 -04:00
Brandon Thomas
d5b28d2d3e
Start setting AVT cookie on /v1/session endpoint
2023-10-19 04:24:50 -04:00
Brandon Thomas
d6a3d4887f
Merge pull request #107 from storytold/bt-revert-sha2-upgrade
...
Revert "Bump sha2 from 0.9.5 to 0.10.5"
2023-10-19 02:44:56 -04:00
Brandon Thomas
cce4f5f3b7
Revert "Bump sha2 from 0.9.5 to 0.10.5"
...
This reverts commit 59f7b6f732 .
2023-10-19 02:44:21 -04:00
Brandon Thomas
9123dbc3d9
Merge pull request #98 from storytold/dependabot/cargo/sha2-0.10.5
...
Bump sha2 from 0.9.5 to 0.10.5
2023-10-19 02:41:04 -04:00
Brandon Thomas
d43a747033
Merge pull request #100 from storytold/dependabot/cargo/rpassword-7.2.0
...
Bump rpassword from 5.0.1 to 7.2.0
2023-10-19 02:40:25 -04:00
Brandon Thomas
c3e5b42bf3
use JwtSigner for session cookie
2023-10-19 02:39:17 -04:00
Michael Chung
25cdbf2f1d
Adding create voice command
2023-10-19 02:09:16 -04:00
dependabot[bot]
59f7b6f732
Bump sha2 from 0.9.5 to 0.10.5
...
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.9.5 to 0.10.5.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.5...sha2-v0.10.5 )
---
updated-dependencies:
- dependency-name: sha2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-19 05:57:20 +00:00
dependabot[bot]
fe7251744f
Bump rpassword from 5.0.1 to 7.2.0
...
Bumps [rpassword](https://github.com/conradkleinespel/rpassword ) from 5.0.1 to 7.2.0.
- [Release notes](https://github.com/conradkleinespel/rpassword/releases )
- [Commits](https://github.com/conradkleinespel/rpassword/compare/v5.0.1...v7.2.0 )
---
updated-dependencies:
- dependency-name: rpassword
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-19 05:56:56 +00:00
Brandon Thomas
fdd60b436a
Merge pull request #99 from storytold/dependabot/cargo/scraper-0.17.1
...
Bump scraper from 0.14.0 to 0.17.1
2023-10-19 01:55:06 -04:00
Brandon Thomas
0836e88f4c
Merge pull request #101 from storytold/dependabot/cargo/diesel-2.1.3
...
Bump diesel from 1.4.6 to 2.1.3
2023-10-19 01:54:46 -04:00
Brandon Thomas
261978f763
Merge pull request #102 from storytold/dependabot/cargo/anyhow-1.0.75
...
Bump anyhow from 1.0.40 to 1.0.75
2023-10-19 01:53:55 -04:00
Brandon Thomas
d072e021d1
Merge pull request #106 from storytold/echelon-cookies
...
Cookie stuff - JWT signer, anonymous visitor cookies, etc.
2023-10-19 01:53:05 -04:00
Brandon Thomas
66442d9eda
Cookie stuff - JWT signer, anonymous visitor cookies, etc.
...
- JWT signer is reusable, tested
- AVT cookies improve the anonymous user experience and will help
internal analytics
2023-10-19 01:37:50 -04:00
Michael Chung
0f4cab9ca3
Added missing new file
2023-10-18 19:50:24 -04:00
Michael Chung
6de4d451ac
Fixed import issues
2023-10-18 19:50:07 -04:00
Michael Chung
9d4e426ace
It is now being tested then we work on the command side.
2023-10-18 18:02:30 -04:00
Michael Chung
bfb5103f46
Merge branch 'master' into feature/enqueue_tts_request
2023-10-18 13:37:23 -04:00
Michael Chung
3308c05836
Need to pull master
2023-10-18 13:26:19 -04:00
Brandon Thomas
5a539e589d
codegen db
2023-10-18 04:53:55 -04:00
Brandon Thomas
604c72179a
password_resets needs a unique index on (user, secret_key)
2023-10-18 02:22:39 -04:00
Michael Chung
be19eefa1a
Upload and create record and were good to do the other command and clean up.
2023-10-18 02:13:59 -04:00
Michael Chung
34e2b1e544
It works runs inference_job
...
Need to upload the file then create the record for download
2023-10-18 02:03:41 -04:00
Brandon Thomas
95152e9a88
fix replacement paths
2023-10-18 00:31:43 -04:00
Michael Chung
cbe8aaa1ba
More fixes
2023-10-18 00:04:33 -04:00
Michael Chung
11185584a7
Fixing typos and virtual env
2023-10-17 22:56:30 -04:00
Michael Chung
76559cf783
fix the env
2023-10-17 22:11:22 -04:00
Michael Chung
2e7bd622f3
fixed a typo
2023-10-17 22:06:42 -04:00
Michael Chung
68048659d4
Testing inference_job
2023-10-17 22:00:14 -04:00
Brandon Thomas
608e94a6a8
Merge pull request #105 from storytold/echelon-config-path-substitution
...
Substitute config absolute paths with magic substitution strings
2023-10-17 21:38:06 -04:00
Brandon Thomas
9e0bee8fba
Substitute config absolute paths with magic substitution strings
2023-10-17 21:37:20 -04:00
Brandon Thomas
dcec9b9e8a
Merge pull request #104 from storytold/echelon-storyteller-home
...
"storyteller root" directory in development
2023-10-17 21:12:51 -04:00
Brandon Thomas
3fc0f45942
"storyteller root" directory in development
2023-10-17 21:04:54 -04:00
Brandon Thomas
bfd325900f
Merge pull request #103 from storytold/echelon-better-envvars
...
Better env var support
2023-10-17 17:00:54 -04:00
Brandon Thomas
1ef7ae1009
Better env var support
2023-10-17 16:31:53 -04:00
Michael Chung
17d51f8d87
Merge branch 'master' into feature/enqueue_tts_request
2023-10-17 13:37:35 -04:00
Brandon Thomas
ca81d1b543
fix build / lint errors
2023-10-16 20:02:41 -04:00
dependabot[bot]
1de3e669d6
Bump anyhow from 1.0.40 to 1.0.75
...
Bumps [anyhow](https://github.com/dtolnay/anyhow ) from 1.0.40 to 1.0.75.
- [Release notes](https://github.com/dtolnay/anyhow/releases )
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.40...1.0.75 )
---
updated-dependencies:
- dependency-name: anyhow
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-16 22:18:42 +00:00
dependabot[bot]
ac39ac0a76
Bump diesel from 1.4.6 to 2.1.3
...
Bumps [diesel](https://github.com/diesel-rs/diesel ) from 1.4.6 to 2.1.3.
- [Release notes](https://github.com/diesel-rs/diesel/releases )
- [Changelog](https://github.com/diesel-rs/diesel/blob/v2.1.3/CHANGELOG.md )
- [Commits](https://github.com/diesel-rs/diesel/compare/v1.4.6...v2.1.3 )
---
updated-dependencies:
- dependency-name: diesel
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-16 22:18:25 +00:00
dependabot[bot]
f9caa7d836
Bump scraper from 0.14.0 to 0.17.1
...
Bumps [scraper](https://github.com/causal-agent/scraper ) from 0.14.0 to 0.17.1.
- [Release notes](https://github.com/causal-agent/scraper/releases )
- [Commits](https://github.com/causal-agent/scraper/compare/v0.14.0...v0.17.1 )
---
updated-dependencies:
- dependency-name: scraper
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-16 22:17:50 +00:00
Michael Chung
5f7a10a54c
Merge branch 'master' into feature/enqueue_tts_request
2023-10-16 09:34:46 -04:00
Brandon Thomas
e478c73ddf
Merge pull request #97 from storytold/echelon-sample-upload
...
Dataset sample upload (not yet tested, but compiles, and needs lots of cleanup)
2023-10-14 12:23:36 -04:00
Brandon Thomas
92676e842c
Dataset sample upload
2023-10-14 12:18:42 -04:00
Michael Chung
7eee225296
Builds again need to clearify what happened to the download function
2023-10-13 15:36:21 -04:00
Michael Chung
1319471c04
Merge branch 'master' into feature/enqueue_tts_request
2023-10-13 10:02:17 -04:00
Brandon Thomas
47e7269880
codegen db
2023-10-13 02:50:15 -04:00
Brandon Thomas
9b83caece1
Merge pull request #96 from storytold/echelon-get-media-file-endpoint
...
v1 of media_file GET endpoint.
2023-10-13 02:40:39 -04:00
Brandon Thomas
138057e105
v1 of media_file GET endpoint.
...
Media files are used for inference outputs, file uploads, Zero Shot
files, etc. We don't have any of the basic CRUD operations around them
yet, so this is a start.
This endpoint will need more metadata - moderation, file provenance,
file details, etc. But this will do for now.
2023-10-13 02:38:34 -04:00
Brandon Thomas
3e8b6f39fe
Merge branch 'master' into feature/enqueue_tts_request
2023-10-12 23:28:08 -04:00
Brandon Thomas
63b4a3180f
filter out sadtalker name
2023-10-12 06:22:39 -04:00
Brandon Thomas
6842794af6
another face detection failure
2023-10-12 06:15:43 -04:00
Brandon Thomas
a963e5146a
more instances of face detection failure
2023-10-12 05:33:56 -04:00
Brandon Thomas
eb65ed5fa8
re-codegen db
2023-10-12 03:52:12 -04:00
Brandon Thomas
f6989230be
write origin_product_category
2023-10-12 03:51:01 -04:00
Brandon Thomas
2d3f29139a
re-codegen db
2023-10-12 02:53:48 -04:00
Brandon Thomas
a059aa7271
fix lints
2023-10-12 02:08:13 -04:00
Brandon Thomas
8699a9e342
record and report frontend_failure_category
2023-10-12 02:04:29 -04:00
Brandon Thomas
48bf168d99
improve readability
2023-10-12 01:14:03 -04:00
Brandon Thomas
f1fd99be15
record frontend_failure_category, emit SadTalker errors
2023-10-12 01:03:36 -04:00
Michael Chung
a0b8849806
Trying to build again.
2023-10-12 00:56:50 -04:00
Brandon Thomas
49db299f96
enums for two new columns
2023-10-11 23:09:18 -04:00
Brandon Thomas
b1e87b7d90
two migrations (media_files, generic_inference_jobs)
...
- media_files.origin_product_category
- generic_inference_jobs.frontend_failure_category
2023-10-11 22:38:23 -04:00
Michael Chung
bb0a4958ef
Need to build and fix the container.
2023-10-11 18:19:40 -04:00
Brandon Thomas
4aacc23101
kill sadtalker jobs
2023-10-11 17:31:41 -04:00
Brandon Thomas
536307c162
analytics queries
2023-10-11 17:11:34 -04:00
Brandon Thomas
d5c86d1345
fix breakage due to s3 client upgrade (YOLO) + lint fixes
2023-10-11 16:53:37 -04:00
Brandon Thomas
1900a31541
Merge pull request #66 from storytold/dependabot/cargo/rust-s3-0.33.0
...
Bump rust-s3 from 0.32.3 to 0.33.0
2023-10-11 16:26:24 -04:00
Brandon Thomas
067538f1c2
Merge pull request #88 from storytold/oct-10-mithoo
...
use usernames to list datasets/voices & simple handler for listing samples
2023-10-11 16:19:21 -04:00
Michael Chung
a256681f6d
Merge branch 'master' into feature/enqueue_tts_request
2023-10-11 12:58:57 -04:00
kasisnu
03443be19c
inventory list voices with pagination
2023-10-11 16:52:37 +05:30
Michael Chung
ec03420efc
Fixed issue with typo in job.
...
Need to fix process job and run it.
2023-10-11 02:51:47 -04:00
Brandon Thomas
bfc8171fa7
additional safeguards
2023-10-11 00:02:36 -04:00
Brandon Thomas
248ee45d11
multithreaded
2023-10-10 23:49:43 -04:00
Brandon Thomas
97be5da1b5
Truncate bucket hash for seeded zero shot voice records
2023-10-10 22:06:16 -04:00
Brandon Thomas
d26902911f
Merge pull request #93 from storytold/feature/fix-database-seed-voice-embeddings
...
Fixed bucket hash issue
2023-10-10 22:00:27 -04:00
Michael Chung
0560a2d607
Fixed bucket hash issue
2023-10-10 20:34:27 -04:00
Michael Chung
264058ea87
Just a quick commit gotta modify the seeding script to get the bucket hashes for downloading
2023-10-10 20:20:56 -04:00
Brandon Thomas
b175cc0e65
cleanup more statuses
2023-10-10 19:24:07 -04:00
Brandon Thomas
ae781a3e37
rename to kubectl- to not collide with base tool in tab complete
2023-10-10 19:15:53 -04:00
Brandon Thomas
ee00fbe585
cleanup pods with these statuses
2023-10-10 19:12:39 -04:00
Brandon Thomas
82791ec39e
delete pods randomly
2023-10-10 18:51:35 -04:00
Brandon Thomas
b6bbc76b18
delete batches
2023-10-10 18:24:57 -04:00
Brandon Thomas
1742827ed9
ergonomics
2023-10-10 18:01:06 -04:00
Brandon Thomas
68bc9d0bb0
Merge pull request #89 from storytold/echelon-kubectl-cli
...
kubectl cli to cleanup dead pods
2023-10-10 17:51:12 -04:00
Brandon Thomas
ccc67d43cc
kubectl cli to cleanup dead pods
2023-10-10 17:50:05 -04:00
Michael Chung
3845c632b2
Turns out we don't support folder downloads only files.
2023-10-10 17:40:33 -04:00
Michael Chung
22518d9164
Fixed pathing typos
2023-10-10 16:24:16 -04:00
Michael Chung
5dbed7afbb
Fixed typo on downloading the vall-e-x model
2023-10-10 16:18:35 -04:00
Michael Chung
a485666b1c
Test pass!
...
Payload delivered and picked up.
Need to ensure the job now runs locally.
2023-10-10 16:03:27 -04:00
Michael Chung
54e9b8af70
Fixed routing issue with the job need to move tts text to maybe tts text out of the json.
2023-10-10 15:32:51 -04:00
kasisnu
5a7b0b1bdd
simple list dataset samples
2023-10-10 19:15:58 +05:30
kasisnu
ee0067161e
use usernames instead of user tokens to list voices/datasets
2023-10-10 18:03:22 +05:30
Brandon Thomas
a0f464e454
Merge pull request #87 from storytold/echelon-dataset-endpoints
...
Dataset endpoints, refactoring, cleanup, etc.
2023-10-10 03:22:21 -04:00
Brandon Thomas
332982faa5
Dataset endpoints, refactoring, cleanup, etc.
2023-10-10 03:16:11 -04:00
Brandon Thomas
c0e142d668
RMVPE support
2023-10-10 01:18:12 -04:00
Brandon Thomas
ca8dce4805
re-codegen db
2023-10-09 23:58:09 -04:00
Brandon Thomas
ed1eb9a540
stop dependabot from suggesting /old_code fixes (maybe delete all this?)
2023-10-09 23:30:16 -04:00
Brandon Thomas
0620fa6f98
extra tests for previously broken upgrade
2023-10-09 23:15:09 -04:00
Brandon Thomas
94adc01d62
Merge pull request #86 from storytold/echelon-cleanup-identifiers
...
Cleanup identifiers (tokens package)
2023-10-09 23:02:15 -04:00
Brandon Thomas
6e76cd3da6
Cleanup identifiers (tokens package)
2023-10-09 23:00:11 -04:00
Brandon Thomas
5a1fd2679c
fix for broken dependabot base64 upgrade (semvar violation)
2023-10-09 22:25:38 -04:00
dependabot[bot]
f5c3e12f90
Bump rust-s3 from 0.32.3 to 0.33.0
...
Bumps [rust-s3](https://github.com/durch/rust-s3 ) from 0.32.3 to 0.33.0.
- [Release notes](https://github.com/durch/rust-s3/releases )
- [Commits](https://github.com/durch/rust-s3/commits/v0.33.0 )
---
updated-dependencies:
- dependency-name: rust-s3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-10 02:02:36 +00:00
Brandon Thomas
0a141ea118
Merge pull request #84 from storytold/dependabot/cargo/cidr-utils-0.5.11
...
Bump cidr-utils from 0.5.10 to 0.5.11
2023-10-09 22:01:02 -04:00
Brandon Thomas
dd6c5d1975
Merge pull request #82 from storytold/dependabot/cargo/base64-0.21.0
...
Bump base64 from 0.13.0 to 0.21.0
2023-10-09 22:00:40 -04:00
Brandon Thomas
91dcd1f876
Merge pull request #83 from storytold/dependabot/cargo/unicode-segmentation-1.10.1
...
Bump unicode-segmentation from 1.7.1 to 1.10.1
2023-10-09 22:00:08 -04:00
Brandon Thomas
1869ead6ad
Merge pull request #85 from storytold/dependabot/cargo/futures-util-0.3.28
...
Bump futures-util from 0.3.26 to 0.3.28
2023-10-09 21:59:34 -04:00
Brandon Thomas
1c81874b28
fix tests and lints
2023-10-09 21:55:48 -04:00
Brandon Thomas
c8b79bfb40
cleanup logic
2023-10-09 21:44:14 -04:00
Brandon Thomas
767d76f831
comments about dev bucket
2023-10-09 21:04:36 -04:00
Brandon Thomas
b163791db2
Merge pull request #77 from storytold/feature/enqueue_tts_request
...
Feature/enqueue tts request
2023-10-09 21:02:26 -04:00
Brandon Thomas
d4e8bfb1f8
Merge pull request #79 from storytold/oct-06-mithoo
...
adds list dataset handler and update/delete voices handler
2023-10-09 20:58:25 -04:00
dependabot[bot]
fabc1583ca
Bump futures-util from 0.3.26 to 0.3.28
...
Bumps [futures-util](https://github.com/rust-lang/futures-rs ) from 0.3.26 to 0.3.28.
- [Release notes](https://github.com/rust-lang/futures-rs/releases )
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.26...0.3.28 )
---
updated-dependencies:
- dependency-name: futures-util
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:08:03 +00:00
dependabot[bot]
804ab3e4e8
Bump cidr-utils from 0.5.10 to 0.5.11
...
Bumps [cidr-utils](https://github.com/magiclen/cidr-utils ) from 0.5.10 to 0.5.11.
- [Commits](https://github.com/magiclen/cidr-utils/compare/v0.5.10...v0.5.11 )
---
updated-dependencies:
- dependency-name: cidr-utils
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:07:31 +00:00
dependabot[bot]
cd0e104808
Bump unicode-segmentation from 1.7.1 to 1.10.1
...
Bumps [unicode-segmentation](https://github.com/unicode-rs/unicode-segmentation ) from 1.7.1 to 1.10.1.
- [Commits](https://github.com/unicode-rs/unicode-segmentation/compare/1.7.1...v1.10.1 )
---
updated-dependencies:
- dependency-name: unicode-segmentation
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:07:00 +00:00
dependabot[bot]
a7d794e29b
Bump base64 from 0.13.0 to 0.21.0
...
Bumps [base64](https://github.com/marshallpierce/rust-base64 ) from 0.13.0 to 0.21.0.
- [Changelog](https://github.com/marshallpierce/rust-base64/blob/master/RELEASE-NOTES.md )
- [Commits](https://github.com/marshallpierce/rust-base64/compare/v0.13.0...v0.21.0 )
---
updated-dependencies:
- dependency-name: base64
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:05:57 +00:00
kasisnu
eed7dc28f8
adds simple voice list endpoint
2023-10-09 18:33:07 +05:30
kasisnu
d4c5710513
filter private/hidden datasets, make user token non-optional
2023-10-09 12:26:54 +05:30
Michael Chung
d8c4df4c02
Ok fixed the odd linting error.
2023-10-06 18:12:04 -04:00
Michael Chung
13809ad309
Fixed issue
2023-10-06 18:04:46 -04:00
Michael Chung
95888e683d
Formatter works now, braces can get properly placed
2023-10-06 18:01:25 -04:00
Michael Chung
3012dea984
process_single_tts_job augmented...
2023-10-06 17:58:07 -04:00
Michael Chung
ae899d8aca
Fixed most of the job and implemented it.
...
Need to run the container this might be fun haha ...
2023-10-06 15:21:38 -04:00
Michael Chung
dda05ba22c
Have to pull master for the lastest seed changes
2023-10-06 13:01:17 -04:00
Brandon Thomas
63795b2cb6
Merge pull request #81 from storytold/echelon-test-weights
...
Add zero shot weights and upload six test files; add to db seed tool
2023-10-06 12:51:20 -04:00
Brandon Thomas
8aa97a6a4f
Add zero shot weights and upload six test files; add to db seed tool
2023-10-06 12:50:02 -04:00
Michael Chung
e23369761b
Merge branch 'master' into feature/enqueue_tts_request
2023-10-06 11:35:11 -04:00
Brandon Thomas
2b27d6fe41
Merge pull request #80 from storytold/echelon-seed-tool-2
...
More seed tool things
2023-10-06 11:30:14 -04:00
Michael Chung
c6eefc41ec
Ok fixed the build now working on job running.
2023-10-06 10:55:51 -04:00
Michael Chung
9e3a3b79f9
job process wip
2023-10-06 09:49:09 -04:00
kasisnu
2aa063c354
some meat on the list datasets handler - filtering logic needs wdork
2023-10-06 18:04:44 +05:30
kasisnu
f77d4a636b
skip mod token when creating datasets
2023-10-06 16:07:29 +05:30
Brandon Thomas
018b05a3a2
Seed voice conversion models
2023-10-06 02:50:12 -04:00
kasisnu
fd3661e25d
list/delete voices simple handlers
2023-10-06 12:07:51 +05:30
Brandon Thomas
39de5aba13
More updates to seed tool
2023-10-06 01:30:43 -04:00
Brandon Thomas
6354e7c3b4
Merge pull request #78 from storytold/echelon-db-seeding
...
Database seed tool
2023-10-06 01:17:59 -04:00
Brandon Thomas
eaa9ddd62d
seed voice
2023-10-06 00:51:52 -04:00
Michael Chung
195a2eeb9c
Outlined the things needed to be done in process_job
2023-10-06 00:49:42 -04:00
Brandon Thomas
bef5dce947
seed dataset
2023-10-06 00:36:15 -04:00
Brandon Thomas
dd3f9c9d3e
move query modules
2023-10-06 00:19:41 -04:00
Brandon Thomas
aac31f77ad
Database seed tool
2023-10-06 00:09:42 -04:00
Brandon Thomas
d07a147db9
Merge pull request #62 from storytold/feat-create-dataset
...
create zs dataset endpoint - basic impl
2023-10-06 00:03:47 -04:00
Michael Chung
ba76acec35
some more fixes to model downloaders
2023-10-05 23:05:27 -04:00
Michael Chung
a2c196587f
Added Inference Command Stub
...
Added Create Embedding Command Stub
Need to implement job process:
Download Embedding File aka voice token.
model_downloaders is all good.
validate_job.
2023-10-05 22:29:25 -04:00
Brandon Thomas
8d36d6c709
Add some downloaders for vall-e-x
2023-10-05 21:43:36 -04:00
Michael Chung
4f5f6cfe51
Getting the pieces ready for inference_job
2023-10-05 13:29:51 -04:00
kasisnu
7c59f267fc
placeholder sql query to create a voice
2023-10-05 17:41:44 +05:30
kasisnu
23a6daa144
list handler questions
2023-10-05 16:34:36 +05:30
kasisnu
a22038ea31
delete datasets & allow mods to undelete
2023-10-05 15:59:56 +05:30
Michael Chung
5de40b2dab
Fix a build issues the payload sends exploring the job creation and inference side of it.
2023-10-04 16:30:46 -04:00
kasisnu
484e6788e3
enforce user token check
2023-10-04 19:02:16 +05:30
kasisnu
b67cfb5fbe
basic update dataset handler & synthetic id tracking
2023-10-04 18:03:13 +05:30
Brandon Thomas
d46075a2a3
codegen
2023-10-04 03:58:05 -04:00
Brandon Thomas
aa9b834f4b
Merge pull request #76 from storytold/echelon-add-media-file-extension
...
Add media prefix and file extension
2023-10-04 03:50:00 -04:00
Brandon Thomas
2abba4b639
populate prefix and extension
2023-10-04 03:34:43 -04:00
kasisnu
c42c091b2d
create zs dataset endpoint - basic impl
2023-10-04 12:32:58 +05:30
Brandon Thomas
cde8447a9c
add table for bucket prefix
2023-10-04 02:33:28 -04:00
Brandon Thomas
4306a4763d
Add extension
2023-10-04 02:24:28 -04:00
Brandon Thomas
9701e29b58
Migration to add file extension (eg. ".mp4")
2023-10-04 02:24:28 -04:00
Brandon Thomas
8512846efa
Merge pull request #75 from storytold/bt-revert-sqlx-upgrade
...
Revert "Bump sqlx-core from 0.6.2 to 0.7.2"
2023-10-04 02:23:09 -04:00
Brandon Thomas
c7b54e1548
Revert "Bump sqlx-core from 0.6.2 to 0.7.2"
...
This reverts commit 6b8c1a3106 .
2023-10-04 02:15:54 -04:00
Brandon Thomas
8343cf1b65
Merge pull request #70 from storytold/dependabot/cargo/sqlx-core-0.7.2
...
Bump sqlx-core from 0.6.2 to 0.7.2
2023-10-04 02:04:06 -04:00
Brandon Thomas
4d4b55d39d
Merge pull request #68 from storytold/dependabot/cargo/once_cell-1.18.0
...
Bump once_cell from 1.17.0 to 1.18.0
2023-10-04 02:03:54 -04:00
dependabot[bot]
6b8c1a3106
Bump sqlx-core from 0.6.2 to 0.7.2
...
Bumps [sqlx-core](https://github.com/launchbadge/sqlx ) from 0.6.2 to 0.7.2.
- [Changelog](https://github.com/launchbadge/sqlx/blob/main/CHANGELOG.md )
- [Commits](https://github.com/launchbadge/sqlx/commits )
---
updated-dependencies:
- dependency-name: sqlx-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 06:03:43 +00:00
Brandon Thomas
63b3cb8216
Merge pull request #67 from storytold/dependabot/cargo/url-2.4.1
...
Bump url from 2.3.1 to 2.4.1
2023-10-04 02:03:25 -04:00
Brandon Thomas
3d4522126e
Merge pull request #65 from storytold/dependabot/cargo/openssl-0.10.57
...
Bump openssl from 0.10.42 to 0.10.57
2023-10-04 02:02:33 -04:00
Brandon Thomas
8be1b5afa3
Merge pull request #69 from storytold/dependabot/cargo/actix-rt-2.9.0
...
Bump actix-rt from 2.7.0 to 2.9.0
2023-10-04 02:02:15 -04:00
dependabot[bot]
11f6995942
Bump actix-rt from 2.7.0 to 2.9.0
...
Bumps [actix-rt](https://github.com/actix/actix-net ) from 2.7.0 to 2.9.0.
- [Release notes](https://github.com/actix/actix-net/releases )
- [Commits](https://github.com/actix/actix-net/compare/rt-v2.7.0...rt-v2.9.0 )
---
updated-dependencies:
- dependency-name: actix-rt
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:56:36 +00:00
dependabot[bot]
589d13fdd1
Bump once_cell from 1.17.0 to 1.18.0
...
Bumps [once_cell](https://github.com/matklad/once_cell ) from 1.17.0 to 1.18.0.
- [Changelog](https://github.com/matklad/once_cell/blob/master/CHANGELOG.md )
- [Commits](https://github.com/matklad/once_cell/compare/v1.17.0...v1.18.0 )
---
updated-dependencies:
- dependency-name: once_cell
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:56:02 +00:00
dependabot[bot]
3f9160701f
Bump url from 2.3.1 to 2.4.1
...
Bumps [url](https://github.com/servo/rust-url ) from 2.3.1 to 2.4.1.
- [Release notes](https://github.com/servo/rust-url/releases )
- [Commits](https://github.com/servo/rust-url/compare/v2.3.1...v2.4.1 )
---
updated-dependencies:
- dependency-name: url
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:55:30 +00:00
Brandon Thomas
9e8c27edfd
Create dependabot.yml
2023-10-04 01:53:23 -04:00
dependabot[bot]
6540aed9dc
Bump openssl from 0.10.42 to 0.10.57
...
Bumps [openssl](https://github.com/sfackler/rust-openssl ) from 0.10.42 to 0.10.57.
- [Release notes](https://github.com/sfackler/rust-openssl/releases )
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.42...openssl-v0.10.57 )
---
updated-dependencies:
- dependency-name: openssl
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:53:08 +00:00
Brandon Thomas
7cd570083c
Merge pull request #64 from storytold/bt-misc-fix
...
fixing a few things
2023-10-04 01:10:15 -04:00
Brandon Thomas
8787e3ef1e
tests for lipsync payload
2023-10-04 01:09:40 -04:00
Brandon Thomas
49b25cc79d
fix query cache codegen
2023-10-04 01:09:40 -04:00
Brandon Thomas
eff73a9cff
actually check premium plan
2023-10-04 01:09:40 -04:00
Brandon Thomas
d0e3e0f6bb
Merge pull request #63 from storytold/bt-twitter-dimensions
...
SadTalker: Final API shape. Twitter dimensions, non-default options are opt-in, premium watermark
2023-10-04 00:31:00 -04:00
Brandon Thomas
e676df0bf4
premium plan features
2023-10-04 00:26:52 -04:00
Brandon Thomas
ebed726768
Resize SadTalker to "twitter" dimensions
2023-10-04 00:26:52 -04:00
Michael Chung
e0145f0e70
Test this endpoint ensure that the record is created and you can see it grabbed.
2023-10-03 19:09:09 -04:00
Brandon Thomas
2f3037514f
takedown requests
2023-10-03 13:38:13 -04:00
Michael Chung
f7c636cf58
Added TTS payloads should be able to enter a entry after a migration then follow the event
...
to the inference dispatch and fill out the code there.
2023-10-02 23:56:52 -04:00
Michael Chung
ec4a172929
Adding generic inference args and creating the job soon
2023-10-02 23:08:28 -04:00
Michael Chung
773b96fb35
Stubbing out work in the handler
...
Adding VallEX as a inference model type
Test pass
2023-10-02 21:45:40 -04:00
Michael Chung
40d0d0d844
Changing up enqueue_infer_tts_handler to allow embedding tokens.
2023-10-02 20:17:36 -04:00
Brandon Thomas
dbae9803e2
Merge pull request #61 from storytold/testing-and-images-libs
...
Libraries for testing and image processing
2023-10-02 16:21:28 -04:00
Brandon Thomas
87093bf291
Libraries for testing and image processing
...
Just getting started here.
2023-10-02 16:20:07 -04:00
Michael Chung
0b3ea3af2a
Working on enqueue_tts_request assuming the prompt is around.
2023-10-02 16:15:25 -04:00
ArEnSc
1a75d5b7b3
Merge pull request #60 from storytold/feature/postman-collections
...
Postman Collections
2023-10-02 14:58:16 -04:00
Michael Chung
fb5dbae029
Added the GPT4Prompt for generating the collections and posted some relevant end points.
2023-10-02 13:41:06 -04:00
Brandon Thomas
d2fba4349d
fix broken lint
2023-10-01 17:17:43 -04:00
Brandon Thomas
b76b4460e3
forgot to codegen after leaderboard query adjustment
2023-10-01 17:10:49 -04:00
Brandon Thomas
5fee53d7c7
Merge pull request #59 from storytold/echelon-sadtalker-options
...
More options for SadTalker
2023-10-01 17:07:33 -04:00
ArEnSc
4f589cd1b7
Merge pull request #58 from storytold/feature/Zeroshot-inference-job1
...
Feature/Stubs for Voice Designer?
2023-10-01 16:53:35 -04:00
Michael Chung
5b9f1551ee
Put stubs behind feature flag.
2023-10-01 16:51:14 -04:00
Michael Chung
e47125f12d
Nested the endpoints wrong because to many ))) and got confused.
2023-10-01 15:04:01 -04:00
Michael Chung
afa050b45e
Testing routes
2023-10-01 13:44:22 -04:00
Brandon Thomas
ab6986e4b4
Merge pull request #57 from storytold/echelon-hide-leaderboard
...
Hide Vegito's test account from TTS leaderboard
2023-10-01 05:45:20 -04:00
Brandon Thomas
53626cb312
More options for SadTalker
2023-10-01 05:07:56 -04:00
Brandon Thomas
a8810a2db8
Hide Vegito's account from TTS leaderboard
2023-09-30 11:07:08 -04:00
Michael Chung
cb8266d61e
Run then test end points for the responses
2023-09-30 01:43:56 -04:00
Michael Chung
056065458f
Early stubs
2023-09-30 01:43:25 -04:00
Michael Chung
7cb18d63f2
Initial stubs for the api
2023-09-30 01:27:36 -04:00
Michael Chung
12a119cc1b
Routing for the backend start
2023-09-29 20:30:09 -04:00
Brandon Thomas
c8d8546c57
Merge pull request #56 from storytold/echelon-zero-shot-tables
...
Zero shot tables
2023-09-29 00:10:16 -04:00
Brandon Thomas
3265e097c0
Zero shot tables
2023-09-28 23:45:31 -04:00
Brandon Thomas
695d3da34b
analytics query
2023-09-28 10:22:38 -04:00
Brandon Thomas
6733a19315
Merge pull request #55 from storytold/echelon-face-detection-early-failure
...
Do not respawn SadTalker jobs when face detection fails
2023-09-28 10:20:23 -04:00
Brandon Thomas
baefb9f7d6
Do not respawn SadTalker jobs when face detection fails
...
Currently SadTalker jobs will retry on failure, which is great for
worker nodes with transient issues. Unfortunately failure to detect a
face is a common user input error occuring in just around half of all
image uploads. This will permanently tombstone these jobs.
The new failure class can be reused for future animation systems that
rely on face detection.
There is still some minor work to do to surface this error to the
frontend / user in a friendly way.
2023-09-28 10:14:16 -04:00
Brandon Thomas
fc47232e6b
Update general_setup.md
2023-09-27 17:27:55 -04:00
Brandon Thomas
83dc262249
make lints and tests pass again
2023-09-26 02:13:16 -04:00
Brandon Thomas
1d3885c367
vendor in easyenv.rs (a crate I wrote)
2023-09-26 02:03:25 -04:00
Brandon Thomas
070433b416
Add watermarking capability
2023-09-22 11:49:55 -04:00
Brandon Thomas
f15b89cf3d
add face animation statistic to queue stats endpoint
2023-09-22 09:19:13 -04:00
Brandon Thomas
699bb6a6a7
Clion auto-optimize imports, remove dead imports, Clippy lint
2023-09-20 01:39:58 -04:00
Brandon Thomas
226f111a00
fix tests, lints
2023-09-20 01:07:26 -04:00
Brandon Thomas
b7794ab48f
ignore test data
2023-09-20 00:13:06 -04:00
Brandon Thomas
0bd5c9e93b
ignore c sources
2023-09-20 00:11:02 -04:00
ArEnSc
5a981f55aa
Merge pull request #54 from storytold/feature/General-Setup-Update
...
Feature/general setup update
2023-09-19 22:33:49 -04:00
michael chung
3e9581a29d
Minor update
2023-09-19 22:32:09 -04:00
michael chung
ab42870ff1
Updated General Setup!
2023-09-19 22:29:53 -04:00
michael chung
998c8ef49d
General Setup Guide Updates!
2023-09-19 22:09:29 -04:00
Brandon Thomas
aa8e7597ee
get rid of redundancy
2023-09-19 20:26:35 -04:00
Brandon Thomas
725d16bbd9
readme: hosts file, running application
2023-09-19 20:13:22 -04:00
Brandon Thomas
f6ee06a72f
updated setup README
2023-09-19 20:01:38 -04:00
Brandon Thomas
14d028ea8a
docs
2023-09-19 18:34:39 -04:00
Brandon Thomas
699c49c02f
cleanup docs
2023-09-19 18:31:00 -04:00
Brandon Thomas
b126998ee3
these are probably obsolete
2023-09-19 18:07:30 -04:00
Brandon Thomas
1b43433b72
Documentation updates
2023-09-19 18:06:37 -04:00
Brandon Thomas
1f7dc268a8
SadTalker arguments (wip)
2023-09-19 17:27:34 -04:00
Brandon Thomas
dda67adc52
optional alternate checkpoint path arg
2023-09-15 10:07:33 -04:00
Brandon Thomas
fa74b9715f
logging for job
2023-09-15 09:28:41 -04:00
Brandon Thomas
653a0b26ce
sleep(50) - ugh
2023-09-15 08:51:44 -04:00
Brandon Thomas
ab8e9b9134
sqlite was failing, emit which is being prepared
2023-09-15 06:36:11 -04:00
Brandon Thomas
dac67ada23
codegen db
2023-09-15 06:35:04 -04:00
Brandon Thomas
f56530e36b
Merge pull request #53 from storytold/bt-sadtalker-backup-2.2
...
Sad Talker worker, file uploads, etc.
2023-09-15 06:32:45 -04:00
Brandon Thomas
3077359165
logs
2023-09-15 06:29:22 -04:00
Brandon Thomas
efdb0377f4
serve bucket paths
2023-09-15 06:15:11 -04:00
Brandon Thomas
4e935a1c2b
worker details
2023-09-15 04:43:23 -04:00
Brandon Thomas
063760663f
get job working again
2023-09-15 04:14:38 -04:00
Brandon Thomas
176cbcc4be
remove directory full path, work on query
2023-09-15 03:33:55 -04:00
Brandon Thomas
359b7a5bd0
migrations, about to insert media file result
2023-09-15 02:19:41 -04:00
Brandon Thomas
9f67a3b82d
SadTalker inference works !
2023-09-14 05:33:08 -04:00
Brandon Thomas
eb0e05f61e
download image and audio
2023-09-14 04:58:28 -04:00
Brandon Thomas
24f6b3c2f6
upload image route
2023-09-12 20:04:58 -04:00
Brandon Thomas
c47bae40d4
download voice conversion result
2023-09-12 20:04:58 -04:00
Brandon Thomas
cf2c246bc2
voice_conversion_for_inference
2023-09-12 20:04:58 -04:00
Brandon Thomas
9b89402549
get_voice_conversion_result query
2023-09-12 20:04:58 -04:00
Brandon Thomas
f2f2bd465c
wip
2023-09-12 20:04:58 -04:00
Brandon Thomas
7e9acc6476
unpack args
2023-09-12 20:04:58 -04:00
Brandon Thomas
7d68347f4f
fixed enqueue, fixed downloaders
2023-09-12 20:04:58 -04:00
Brandon Thomas
655f9fad7d
downloaders
2023-09-12 20:04:58 -04:00
Brandon Thomas
754581ec70
impl_model_downloader appears to work
2023-09-12 20:04:58 -04:00
Brandon Thomas
80b7352581
async trait/macro starting to work
2023-09-12 20:04:58 -04:00
Brandon Thomas
dd7bd71587
model downloader trait wip
2023-09-12 20:04:58 -04:00
Brandon Thomas
e41f72305b
(from other laptop) - inference args work, inference-job boilerplate
2023-09-12 20:04:58 -04:00
Brandon Thomas
fa2a15a4f2
install route
2023-09-12 20:04:58 -04:00
Brandon Thomas
eddb71d712
enqueue animation endpoint + more plumbing
2023-09-12 20:04:58 -04:00
Brandon Thomas
71758e6616
upload images (untested)
2023-09-12 20:04:58 -04:00
Brandon Thomas
7afa50ce29
another 101soundboards account
2023-09-12 18:42:38 -04:00
Brandon Thomas
14480e50b4
analytics queries
2023-08-31 22:45:43 -04:00
Brandon Thomas
b99e4c5edb
more 101soundboards accounts and notes
2023-08-31 22:31:38 -04:00
Brandon Thomas
f5b7ad0428
analytics queries
2023-08-30 22:49:55 -04:00
Brandon Thomas
ff2713358d
imyfone notes
2023-08-28 21:37:28 -04:00
Brandon Thomas
60ab3565bd
101soundboards notes
2023-08-28 21:34:53 -04:00
Brandon Thomas
d4ee7a8673
ban some abusers
2023-08-28 21:31:49 -04:00
Brandon Thomas
8e15e1e14c
media_files enums
2023-08-23 21:33:06 -04:00
Brandon Thomas
a8f0947352
media file token
2023-08-23 21:14:45 -04:00
Brandon Thomas
2600762df2
mysql table: media_files
2023-08-23 21:01:49 -04:00
Brandon Thomas
1100fc1a91
clion/intellij formatting rules
2023-08-23 18:03:56 -04:00
Brandon Thomas
a538989c57
UserInfoLite shared response type
2023-08-23 18:03:36 -04:00
Brandon Thomas
a4524ee679
execute all lints and tests
2023-08-23 17:13:11 -04:00
Brandon Thomas
1551a014a4
revisit rustfmt with minimal changes to formatting
2023-08-21 00:59:52 -04:00
Brandon Thomas
e5afff51a6
Change rustfmt rules
2023-08-21 00:32:17 -04:00
Brandon Thomas
9a7b746460
return statement lint
2023-08-21 00:23:09 -04:00
Brandon Thomas
a63b085086
Clippy: fix for newrelic, lint duplicate field name
2023-08-20 21:56:20 -04:00
Brandon Thomas
3b40f005d0
add storyteller.ai hostname
2023-08-20 21:01:57 -04:00
Brandon Thomas
afc4fbdcb5
lints
2023-08-20 20:59:22 -04:00
Brandon Thomas
63008a7fe8
analytics query
2023-08-18 09:01:57 -04:00
Brandon Thomas
902c840833
takedown request
2023-08-18 08:49:05 -04:00
Brandon Thomas
e8a8c6349f
clippy
2023-08-16 16:00:37 -04:00
Brandon Thomas
76a62eaece
more lints (add gradually)
2023-08-16 02:57:06 -04:00
Brandon Thomas
226fb93a36
lint progress
2023-08-16 02:28:48 -04:00
Brandon Thomas
1868170c31
more progress on lints
2023-08-16 01:51:30 -04:00
Brandon Thomas
7ecdac5151
Lint script
2023-08-16 01:34:24 -04:00
Brandon Thomas
f41833e4f4
cargo cranky: &'static
2023-08-15 23:56:03 -04:00
Brandon Thomas
bd9c4d752f
move includes to single root dir
2023-08-15 23:42:01 -04:00
Brandon Thomas
7dab1b9ea1
username reservations
2023-08-14 14:33:32 -04:00
Brandon Thomas
512b214fb8
cargo 'cranky' (clippy helper)
2023-08-10 16:50:25 -04:00
Brandon Thomas
21e2eeac68
remove more duplicates
2023-08-10 15:28:43 -04:00
Brandon Thomas
ec7a61a08e
remove duplicates
2023-08-10 15:00:05 -04:00
Brandon Thomas
c195a23425
inventory duplicates
2023-08-10 14:49:03 -04:00
Brandon Thomas
2c61db12d6
takedown requests
2023-08-10 14:36:24 -04:00
Brandon Thomas
8bac7ca332
analytics queries
2023-08-10 14:22:32 -04:00
Brandon Thomas
56fb99aa81
takedown request
2023-08-07 16:28:58 -04:00
Brandon Thomas
e87091c5cb
re-codegen
2023-07-30 18:13:30 -04:00
Brandon Thomas
ffb081777d
Enrich stats query with per-queue info
2023-07-30 18:12:45 -04:00
Brandon Thomas
e8be6f9775
improved queue length query
2023-07-30 17:26:07 -04:00
Brandon Thomas
2094ab2fe8
query
2023-07-30 16:21:23 -04:00
Brandon Thomas
596434868c
takedown requests, duplicates
2023-07-30 00:15:40 -04:00
Brandon Thomas
14c5f02127
takedown requests
2023-07-30 00:04:07 -04:00
Brandon Thomas
ffc018ee18
broken clients
2023-07-27 23:54:57 -04:00
Brandon Thomas
0b7f08e838
cache queue stats in Redis
2023-07-27 04:03:07 -04:00
Brandon Thomas
3a8398a94e
much better logging for download jobs
2023-07-27 03:10:55 -04:00
Brandon Thomas
35e26e7f72
more queries
2023-07-27 02:48:00 -04:00
Brandon Thomas
3e6b4c43af
scope download job
2023-07-27 01:30:33 -04:00
Brandon Thomas
e5289809fd
more analytics queries
2023-07-26 01:13:38 -04:00
Brandon Thomas
b335e1839c
analytics queries
2023-07-25 16:59:08 -04:00
Brandon Thomas
ce3f83e9af
subscriber analytics
2023-07-24 23:46:36 -04:00
Brandon Thomas
e324c6ce44
query to restart failed downloads
2023-07-24 20:43:38 -04:00
Brandon Thomas
062a80fafa
more analytics, etc. queries
2023-07-24 19:22:47 -04:00
Brandon Thomas
986e8b104a
most popular VC models analytics query
2023-07-24 17:15:06 -04:00
Brandon Thomas
1e948a51e9
logging, common media upload query
2023-07-24 02:06:16 -04:00
Brandon Thomas
f9b7a0e774
fix bug
2023-07-23 23:41:21 -04:00
Brandon Thomas
4db56881c0
debugging type error
2023-07-23 23:36:57 -04:00
Brandon Thomas
c11b2f0a94
better logging
2023-07-23 21:46:26 -04:00
Brandon Thomas
3d9a0cfcc1
scoped job execution
2023-07-23 21:32:39 -04:00
Brandon Thomas
b019968ce1
re codegen db
2023-07-23 19:12:59 -04:00
Brandon Thomas
31c88d6d64
Poll voice conversion model info; pull from cache
2023-07-23 19:12:16 -04:00
Brandon Thomas
a601998fa5
query for voice conversion model info
2023-07-23 18:08:45 -04:00
Brandon Thomas
c1ccfb419a
in-memory token info cache
2023-07-23 17:54:41 -04:00
Brandon Thomas
d9a1fcf989
types on inference jobs are wrong (gradually fixing)
2023-07-23 17:33:57 -04:00
Brandon Thomas
839b33425a
keep alive elapses shouldn't be system failures
2023-07-20 23:58:29 -04:00
Brandon Thomas
8017fef05a
rename files across devices
2023-07-20 23:50:19 -04:00
Brandon Thomas
0534db0033
inference-job: more logging, default location for rvc hubert
2023-07-20 23:30:53 -04:00
Brandon Thomas
ef53568dcf
correct comment
2023-07-20 20:16:58 -04:00
Brandon Thomas
72c5c99a1c
no longer log nvidia-smi spam
2023-07-20 20:16:32 -04:00
Brandon Thomas
0b0a9c428c
fix python logger issue with rvc-v2
2023-07-20 19:58:46 -04:00
Brandon Thomas
a9f0b1d485
fix deletion of directory bug
2023-07-20 18:07:52 -04:00
Brandon Thomas
76dc39df16
Fix list jobs query (now that it isn't statically typed)
2023-07-20 18:04:53 -04:00
Brandon Thomas
79d8af8bf4
re-codegen db
2023-07-20 17:44:03 -04:00
Brandon Thomas
b1d69ba9ac
no-op comment to trigger build
2023-07-20 15:06:17 -04:00
Brandon Thomas
ffcf460291
scope download job type
2023-07-20 14:40:28 -04:00
Brandon Thomas
f0a8b6d175
additional logging for download-job
2023-07-20 01:41:59 -04:00
Brandon Thomas
e3a5d68fcc
download hubert for inference-job
2023-07-20 00:02:41 -04:00
Brandon Thomas
877b95a00c
Download pretrained hubert for download-job
2023-07-19 23:36:38 -04:00
Brandon Thomas
20e32ff3e3
begin handling hubert
2023-07-19 22:35:42 -04:00
Brandon Thomas
97a6f6e4ff
add health checker to download-job
2023-07-19 19:52:24 -04:00
Brandon Thomas
cf27fca799
Merge pull request #52 from storytold/bt-upgrade-actix-4
...
upgrade to actix 4
2023-07-19 02:53:40 -04:00
Brandon Thomas
5eab05753f
fix broken tests
2023-07-19 02:52:11 -04:00
Brandon Thomas
385e1e53c1
update middleware
2023-07-19 02:41:40 -04:00
Brandon Thomas
039e61499f
fix routes generics / upgrade generics on routing pieces
2023-07-19 01:57:51 -04:00
Brandon Thomas
9dd91ce7cc
only a few compile errors left with storyteller-web
2023-07-19 01:09:10 -04:00
Brandon Thomas
a75c1f391a
Upgrade actix partially (was on beta version)
...
Old version was causing conflicts with zip and transitive bzip
dependency, so it's time to upgrade. We need to get to the next version
number soon anyway.
2023-07-19 00:20:49 -04:00
Brandon Thomas
d833b3babd
Merge pull request #51 from storytold/bt-rvc-v2-support
...
RVC v2 support
2023-07-18 23:06:49 -04:00
Brandon Thomas
1427e3eecd
Handle zip files with .index files
2023-07-18 23:05:46 -04:00
Brandon Thomas
45990f5631
research
2023-07-18 17:57:37 -04:00
Brandon Thomas
5653a918c0
codegen db (was there an sqlite issue?)
2023-07-18 16:53:08 -04:00
Brandon Thomas
8172774a98
Handle RVC models without an index file
2023-07-18 16:50:44 -04:00
Brandon Thomas
6189d6fe9d
working rvc(v2), it needs cleanup; also fixed race condition
2023-07-18 02:13:46 -04:00
Brandon Thomas
395940ef34
Progress on rvc inference job (not working yet)
2023-07-18 01:55:39 -04:00
Brandon Thomas
85cfc0cf2e
env files
2023-07-18 00:10:57 -04:00
Brandon Thomas
93e066e70b
fixing rvc uploads
2023-07-17 17:10:14 -04:00
Brandon Thomas
5cb79a5a33
Begin work on download-job rvc-v2 support
2023-07-17 16:24:35 -04:00
Brandon Thomas
6b06a825f3
Merge pull request #50 from storytold/bt-saj-rvc-integration
...
Bt saj rvc integration
2023-07-16 19:26:23 -04:00
Brandon Thomas
d653260ee5
Change enum variant name
2023-07-16 19:22:00 -04:00
Paul Sajna
c8530e186e
rvc stubs
2023-07-15 21:56:46 -04:00
Brandon Thomas
aee52c04ff
Fix failing builds (everything was working before)
...
Something mysteriously made my machine think we needed nightly.
Begone, nightly.
2023-07-15 21:55:59 -04:00
Brandon Thomas
cd91acb4a8
fix compile error
2023-07-15 21:13:37 -04:00
Brandon Thomas
d591472478
Merge pull request #49 from storytold/new-queries
...
new queries
2023-07-14 10:59:11 -04:00
Brandon Thomas
c14073f06d
new queries
2023-07-14 10:58:34 -04:00
Brandon Thomas
edde256ff6
delete more duplicates
2023-06-27 15:33:50 -07:00
Brandon Thomas
c6bcd25b19
get rid of takedown request models, duplicate models
2023-06-27 15:20:37 -07:00
Brandon Thomas
82c1563459
comments about users
2023-06-25 21:51:18 -07:00
Brandon Thomas
866ed89d9c
refactor disabled endpoint filter
2023-06-25 21:21:53 -07:00
Brandon Thomas
ac4ffb4f34
refactor
2023-06-25 20:57:36 -07:00
Brandon Thomas
41fe0866d4
refactor ip filter
2023-06-25 20:42:06 -07:00
Brandon Thomas
de3e2e8924
cidr refactor
2023-06-25 20:28:31 -07:00
Brandon Thomas
800c9bd9d5
Add cidr filter
2023-06-25 20:11:59 -07:00
Brandon Thomas
1fe62a2570
Actix CIDR filter
2023-06-25 19:59:01 -07:00
Brandon Thomas
f293b56089
Merge pull request #47 from storytold/bt-block-alibaba
...
block a few Alibaba IPs
2023-06-23 21:23:43 -04:00
Brandon Thomas
a0a2d1434f
block a few Alibaba IPs
2023-06-23 18:23:03 -07:00
Brandon Thomas
8ba1d9f303
Merge pull request #45 from storytold/bevy-experiments
...
roko bevy testing
2023-06-20 10:17:23 -04:00
Paul Sajna
a11779e3aa
roko bevy testing
2023-06-19 11:31:32 -07:00
Brandon Thomas
5c46fd7c60
easier to see logs in k8s
2023-06-17 19:02:28 -07:00
Brandon Thomas
09e26164b8
even beefier build machines
2023-06-17 18:32:58 -07:00
Brandon Thomas
8c24b0c755
log job successes
2023-06-17 18:18:15 -07:00
Brandon Thomas
83ae73d8d0
improperly counting successes
2023-06-17 18:05:34 -07:00
Brandon Thomas
1d0db0eeb9
install nvidia-container packages
2023-06-17 16:12:19 -07:00
Brandon Thomas
04581d06ee
better exit status
2023-06-17 14:14:29 -07:00
Brandon Thomas
a31ecc01ab
configurable health threshold
2023-06-17 11:43:25 -07:00
Brandon Thomas
be20e105ea
Health check HTTP server runs and shuts down
2023-06-17 11:39:34 -07:00
Brandon Thomas
67864f3db2
Both job and HTTP server (doesn't respond to ctrl-c)
2023-06-17 11:05:27 -07:00
Brandon Thomas
10c277d9cf
health check endpoint (not installed)
2023-06-17 07:49:27 -07:00
Brandon Thomas
c6e4c2e274
job stats (consecutive success, failure) for inference-job
2023-06-16 21:42:00 -07:00
Brandon Thomas
a3815ad64d
Merge pull request #43 from storytold/saj-audiowmark
...
audiowmark wrapper
2023-05-29 23:23:37 -04:00
Paul Sajna
8cd48fcf58
audiowmark wrapper
2023-05-29 20:15:45 -07:00
Brandon Thomas
523c02326b
more logging
2023-05-28 22:34:48 -07:00
Brandon Thomas
37eef276a0
more logger methods
2023-05-28 21:20:30 -07:00
Brandon Thomas
f5cbedb230
fix logger
2023-05-28 21:01:14 -07:00
Brandon Thomas
6994a9c2ce
documentation
2023-05-28 19:07:45 -07:00
Brandon Thomas
213742ff29
override python logger in dockerfile
2023-05-28 19:05:51 -07:00
Brandon Thomas
df4f1e6a6c
fix log levels
2023-05-28 19:04:09 -07:00
Brandon Thomas
64fa281bc1
parameter for flushing logs
2023-05-28 18:52:01 -07:00
Brandon Thomas
bd386aa70b
don't need the logger.py in isolation
2023-05-28 18:16:35 -07:00
Brandon Thomas
28875c9272
Add patches to upstream logger
2023-05-28 18:16:11 -07:00
Brandon Thomas
a79bfc7a24
add version of logger we're using in production - we'll patch instead
2023-05-28 17:42:32 -07:00
Brandon Thomas
ecca8ff17c
we'll need to replace python logging in our container for performance
2023-05-28 17:33:04 -07:00
Brandon Thomas
a3cabf6779
fix import
2023-05-28 00:53:59 -07:00
Brandon Thomas
dd35a7cca9
ignore sensitive env vars
2023-05-28 00:52:05 -07:00
Brandon Thomas
f876cac4cf
job pause file
2023-05-27 23:23:42 -07:00
Brandon Thomas
d2b840cb13
analytics queries
2023-05-27 00:32:09 -07:00
Brandon Thomas
85bac00194
password_reset table
2023-05-23 02:12:58 -07:00
Brandon Thomas
367a516f89
fix option typo
2023-05-23 01:41:01 -07:00
Brandon Thomas
5fe85072a2
pack more in docker container, "hacky fix" flag for so-vits-svc
2023-05-23 00:16:11 -07:00
Brandon Thomas
5867d2356c
install vim
2023-05-22 22:21:53 -07:00
Brandon Thomas
275333c1ed
netstat in docker image
2023-05-22 17:44:41 -07:00
Brandon Thomas
5ec2cde68f
report errors better
2023-05-22 11:15:19 -07:00
Brandon Thomas
daf5a63f86
cleanup temp dir
2023-05-22 02:44:34 -07:00
Brandon Thomas
2fe3d5dc99
add less to container
2023-05-22 02:38:20 -07:00
Brandon Thomas
44df952bd1
fix inference job path for VC uploaded audio
2023-05-22 01:51:12 -07:00
Brandon Thomas
5bf98f70d9
rework where temp storage lives: download vs workspace
2023-05-22 00:52:49 -07:00
Brandon Thomas
af685b37cf
fix keepalive redis in job
2023-05-21 22:11:19 -07:00
Brandon Thomas
0f7ff50cf6
better error logging
2023-05-21 20:01:08 -07:00
Brandon Thomas
1ae8d8d615
Fail jobs with elapsed keepalive
2023-05-21 18:16:44 -07:00
Brandon Thomas
63c0124267
test execution safety
2023-05-21 17:52:53 -07:00
Brandon Thomas
17e8c1942e
codegen db
2023-05-21 17:49:58 -07:00
Brandon Thomas
cf24a07bba
Set keepalive key
2023-05-21 17:48:29 -07:00
Brandon Thomas
9ece30722f
Enqueue inferene with keepalive flag
2023-05-21 17:21:17 -07:00
Brandon Thomas
9ab977d016
Add job table keepalive column
2023-05-21 17:04:02 -07:00
Brandon Thomas
ebd3f52717
tmux to gpu container
2023-05-19 04:22:53 -07:00
Brandon Thomas
35a75e144a
unban IP
2023-05-19 04:08:29 -07:00
Brandon Thomas
4b145a7419
Patch for firefox opus audio uploads failing
2023-05-19 04:06:36 -07:00
Brandon Thomas
eb539e9142
query was wrong
2023-05-19 02:08:51 -07:00
Brandon Thomas
37604cdd7b
config
2023-05-19 02:48:22 -04:00
Brandon Thomas
f724031aa3
config
2023-05-19 02:44:14 -04:00
Brandon Thomas
b8b10f6fc1
f0-method and frequency transpose for job
2023-05-18 12:17:08 -07:00
Brandon Thomas
bd4bcab2c2
args for pitch/f0 method in http handler
2023-05-18 00:14:42 -07:00
Brandon Thomas
caa3e3ae53
clear filesystem when full
2023-05-16 01:13:54 -07:00
Brandon Thomas
7cd8099ab5
variable length tts inference text
2023-05-15 00:47:57 -07:00
Brandon Thomas
6ec39b9c68
loyalty for VC contributors
2023-05-14 21:00:27 -07:00
Brandon Thomas
c8b4b7daa0
analytics queries
2023-05-13 09:27:57 -07:00
Brandon Thomas
a294549d02
queries
2023-05-09 12:55:07 -04:00
Brandon Thomas
33ff75274f
add ripgrep
2023-05-04 06:17:12 -07:00
Brandon Thomas
945e5226c5
add a few tools to the container
2023-05-04 03:47:54 -07:00
Brandon Thomas
85a52cd26e
config comments
2023-05-04 03:09:23 -04:00
Brandon Thomas
32ee4209da
this configuration works
2023-05-04 03:07:38 -04:00
Brandon Thomas
f94cdac47d
local dev confi
2023-05-03 23:18:53 -04:00
Brandon Thomas
a2ea870ac7
update nvidia driver ???
2023-05-02 23:01:29 -07:00
Brandon Thomas
a2c48d7469
kill subprocess if timeout elapses
2023-05-02 22:19:03 -07:00
Brandon Thomas
fe3dd7d66b
add routing tags to inference jobs
2023-05-02 21:31:39 -07:00
Brandon Thomas
88fae4ba89
timeout argument
2023-05-02 06:12:49 -07:00
Brandon Thomas
6505e67bf2
analytics
2023-05-02 04:37:21 -07:00
Brandon Thomas
3453fe0e3b
add minor logging
2023-05-02 01:18:25 -07:00
Brandon Thomas
8b36d870d1
fix inference job, add env perameter for threshold
2023-05-01 06:52:34 -07:00
Brandon Thomas
9555ac51fe
Skip jobs that aren't on filesystem
2023-05-01 06:42:41 -07:00
Brandon Thomas
f00b4011b5
record inferecne duration stats to db
2023-05-01 04:17:36 -07:00
Brandon Thomas
d1d208d714
add more timing stats to the jobs tables
2023-05-01 03:59:05 -07:00
Brandon Thomas
a5ce9a3cc4
analytics
2023-04-30 08:16:27 -07:00
Brandon Thomas
6ad2468e59
analytics queries
2023-04-30 08:09:07 -07:00
Brandon Thomas
c59695343f
extend media/symphonia to work with webm+opus
2023-04-30 05:03:40 -07:00
Brandon Thomas
52a83609b6
test case for failing web browser uploads
2023-04-30 00:31:03 -07:00
Brandon Thomas
f710b68a3e
Fix broken tests, add testing script
2023-04-29 23:56:48 -07:00
Brandon Thomas
3d63e34ca1
analytics queries
2023-04-29 23:36:02 -07:00
Brandon Thomas
4a1f1441bf
split analytics and operational queries
2023-04-29 06:08:34 -07:00
Brandon Thomas
ee90f03436
add extra inference job stats
2023-04-29 05:11:57 -07:00
Brandon Thomas
1858aea619
new job queue stats endpoint
2023-04-29 04:58:51 -07:00
Brandon Thomas
592ba627be
documentation
2023-04-29 03:53:31 -07:00
Brandon Thomas
f754c6e41f
add execution time to job queries
2023-04-29 03:10:31 -07:00
Brandon Thomas
54af3d301c
Add execution millis columns to jobs tables
2023-04-29 02:41:49 -07:00
Brandon Thomas
22eeacf355
stricter compiler flags
2023-04-29 02:30:41 -07:00
Brandon Thomas
630aa497f3
note
2023-04-29 02:28:32 -07:00
Brandon Thomas
6e9c05c596
bootstrap / env config improved, on-prem, etc.
2023-04-29 02:26:13 -07:00
Brandon Thomas
3f781ad98f
clean up worker hostname / cluster name in jobs
2023-04-29 02:16:17 -07:00
Brandon Thomas
5d038fdf8f
codegen db
2023-04-29 01:50:14 -07:00
Brandon Thomas
a09acf7c53
add extra metadata to inference and download jobs
2023-04-29 01:49:25 -07:00
Brandon Thomas
3ba64618c3
add tracking columns to generic_inference_job too
2023-04-29 00:17:44 -07:00
Brandon Thomas
73e583c7ed
Add extra metadata tracking to generic download jobs table
2023-04-29 00:08:54 -07:00
Brandon Thomas
1d7a54f640
python for docker image
2023-04-28 16:09:38 -07:00
Brandon Thomas
552fae54a7
fix
2023-04-28 16:02:04 -07:00
Brandon Thomas
4d2ae85fd9
send hubert path for docker
2023-04-28 16:01:18 -07:00
Brandon Thomas
76775dec60
hubert path config
2023-04-28 15:54:53 -07:00
Brandon Thomas
22bc8d54a0
organize settings
2023-04-28 18:46:18 -04:00
Brandon Thomas
878bff867a
fix dev env vars
2023-04-28 02:01:11 -04:00
Brandon Thomas
05d5bfc1a7
rename
2023-04-27 23:00:16 -07:00
Brandon Thomas
3acdd0b5e2
rebase fix
2023-04-28 01:47:40 -04:00
Brandon Thomas
1a7a74ee8a
so-vits-svc auto_predict_f0 default to false, add option
2023-04-27 22:45:28 -07:00
Brandon Thomas
820f4ebc32
fix firefox/opus again
2023-04-27 15:54:13 -07:00
Brandon Thomas
423fb369db
add audio/opus
2023-04-27 08:15:46 -07:00
Brandon Thomas
2a58079289
copy all env vars to child process
2023-04-27 07:19:46 -07:00
Brandon Thomas
b2df674178
report mimetype errors
2023-04-27 02:00:31 -07:00
Brandon Thomas
1fd33e76b4
update base image
2023-04-27 01:02:23 -07:00
Brandon Thomas
824683b974
fixup dockerfile
2023-04-27 00:50:45 -07:00
Brandon Thomas
4bed11d21d
change name again
2023-04-27 00:12:48 -07:00
Brandon Thomas
13bdcbdda6
fix names of actions
2023-04-27 00:11:40 -07:00
Brandon Thomas
f49c724303
GPU + CPU dockerfiles
2023-04-27 00:09:31 -07:00
Brandon Thomas
a9502c183b
flexible config path for inference job
2023-04-26 10:17:49 -07:00
Brandon Thomas
b469a237ce
temporarily add nvidia/sound packages to rust monorepo images
2023-04-26 09:14:17 -07:00
Brandon Thomas
0df93c48c3
configs for download job
2023-04-26 07:48:31 -07:00
Brandon Thomas
070c192633
set config and test wav upfront and at runtime
2023-04-26 07:43:59 -07:00
Brandon Thomas
75a68c7e0f
install python
2023-04-26 05:45:28 -07:00
Brandon Thomas
b2db079cf5
env vars for docker
2023-04-26 04:46:40 -07:00
Brandon Thomas
6658281a1c
try more env vars for caching
2023-04-26 04:38:27 -07:00
Brandon Thomas
8cb04f1dcb
huggingface+nltk caches
2023-04-26 04:25:43 -07:00
Brandon Thomas
58f6ee68df
more flexible command specification
2023-04-26 04:11:06 -07:00
Brandon Thomas
d0cef7bec9
hack
2023-04-26 03:30:38 -07:00
Brandon Thomas
8eed406fbd
inference-job hack (see if we can run without 'svc' command)
2023-04-26 01:31:02 -07:00
Brandon Thomas
44586c4cee
copy the correct env var files
2023-04-25 20:56:18 -07:00
Brandon Thomas
02f5aacb8e
more robust configuration of download-job
2023-04-25 20:55:18 -07:00
Brandon Thomas
001ff86ed3
robust configuration for download-job
2023-04-25 20:51:51 -07:00
Brandon Thomas
94b406eca2
much more robust app initialization
2023-04-25 20:44:59 -07:00
Brandon Thomas
f8bdea1b3b
build error fix
2023-04-25 17:20:21 -07:00
Brandon Thomas
8a37a7240c
more DDoS IPs
2023-04-25 17:16:29 -07:00
Brandon Thomas
a4c1abfe9c
codegen
2023-04-25 06:07:01 -07:00
Brandon Thomas
6bb7a18676
report model title
2023-04-25 04:13:28 -07:00
Brandon Thomas
a8173226ea
report bucket hash in results
2023-04-25 03:00:31 -07:00
Brandon Thomas
692c3f64b6
two different firehose notifications
2023-04-25 01:33:47 -07:00
Brandon Thomas
4842b9bbc1
local dev config changes
2023-04-25 04:28:00 -04:00
Brandon Thomas
a507f8bc38
nope, didn't work
2023-04-25 01:27:28 -07:00
Brandon Thomas
24f2c07199
try to fix duration bug
2023-04-25 01:25:13 -07:00
Brandon Thomas
e871dde078
add upload source
2023-04-25 01:09:24 -07:00
Brandon Thomas
47ff379018
timeout
2023-04-24 02:53:59 -07:00
Brandon Thomas
cdb0f37889
downgrode symphonia off-master branch to support opus for browsers
2023-04-24 02:32:13 -07:00
Brandon Thomas
6d7c3c6e5f
maybe build with correct codecs?
2023-04-24 01:46:52 -07:00
Brandon Thomas
7b72d51bd3
debug logging
2023-04-24 01:11:37 -07:00
Brandon Thomas
11a9e1249c
remove inference args (for now)
2023-04-23 23:29:09 -07:00
Brandon Thomas
f3a6ddb70a
premium priority levels
2023-04-23 23:05:24 -07:00
Brandon Thomas
d2aa07228b
simplify upload endpoint
2023-04-23 22:30:13 -07:00
Brandon Thomas
a2c3668beb
upload audio endpoint
2023-04-23 22:25:46 -07:00
Brandon Thomas
15d66a4530
propagate media input token to inference result
2023-04-23 20:48:09 -07:00
Brandon Thomas
75523811e4
ops query
2023-04-23 13:59:01 -07:00
Brandon Thomas
4672102da4
code changes stemming from schema changes
2023-04-23 05:03:37 -07:00
Brandon Thomas
ca59189dd9
simplify media_uploads schema
2023-04-23 04:31:00 -07:00
Brandon Thomas
3564c1b459
more schema mods
2023-04-23 04:13:50 -07:00
Brandon Thomas
78263e3c49
media token type
2023-04-23 03:58:16 -07:00
Brandon Thomas
e36fb66e05
migrate voice_conversion_results
2023-04-23 03:24:05 -07:00
Brandon Thomas
1540d87018
cleanup
2023-04-23 02:12:46 -07:00
Brandon Thomas
61f0869359
calculate result metadata
2023-04-23 02:02:49 -07:00
Brandon Thomas
d23c7abfeb
remove deprecated crate -> move hashing + mimetype functions out
2023-04-23 01:31:58 -07:00
Brandon Thomas
2d59891dee
organize "file"-related/adjacent crates together
2023-04-23 00:27:09 -07:00
Brandon Thomas
2f86bc75ac
crate to handle just mimetype ops
2023-04-23 00:08:59 -07:00
Brandon Thomas
8c5fb0bee2
badge granter for voice conversion models
2023-04-22 06:22:06 -07:00
Brandon Thomas
b9f0d7749d
fix transaction
2023-04-22 05:36:22 -07:00
Brandon Thomas
b2caa3758a
fix synthetic id
2023-04-22 05:22:06 -07:00
Brandon Thomas
de656d4d74
fix
2023-04-22 04:47:09 -07:00
Brandon Thomas
c803232a52
creator synthetic id
2023-04-22 04:44:40 -07:00
Brandon Thomas
cd9b0080dd
fix result upload directory
2023-04-22 04:04:15 -07:00
Brandon Thomas
6885eb5fc9
temporarily don't get file metadata
2023-04-22 03:55:25 -07:00
Brandon Thomas
100ad0da35
use public bucket client
2023-04-22 03:48:52 -07:00
Brandon Thomas
7010d56bc3
error handling json hydration
2023-04-22 03:44:10 -07:00
Brandon Thomas
b34371eef0
try to only parse payload if not empty string
2023-04-22 03:42:29 -07:00
Brandon Thomas
e6542438b5
create model storage directory
2023-04-22 03:29:26 -07:00
Brandon Thomas
287e3e5f0c
inference for local dev
2023-04-22 02:17:58 -07:00
Brandon Thomas
8fcb908af9
code compiles
2023-04-22 02:14:44 -07:00
Brandon Thomas
56e84f434f
forgot schema migrations
2023-04-22 02:05:44 -07:00
Brandon Thomas
925f2d78ae
more sane schema for voice conversion results (bucket storage)
2023-04-22 02:04:44 -07:00
Brandon Thomas
90219594bb
insert result record
2023-04-22 01:43:24 -07:00
Brandon Thomas
08e8560499
voice conversion result upload (WIP)
2023-04-21 23:27:20 -07:00
Brandon Thomas
9e38b9a2fc
progress on so-vits-svc inference
2023-04-21 23:12:24 -07:00
Brandon Thomas
e9a6320eab
so-vits-svc inference (wip)
2023-04-21 21:51:37 -07:00
Brandon Thomas
da05885d7d
don't upload duplicates
2023-04-21 05:54:10 -07:00
Brandon Thomas
ba9f716ff8
encode fewer bytes in inference jobs
2023-04-21 02:24:23 -07:00
Brandon Thomas
2633c5f0ef
clean up tokens in vc inference
2023-04-21 02:05:14 -07:00
Brandon Thomas
da805b4f1d
clean upload hashing, better error messages
2023-04-21 00:22:58 -07:00
Brandon Thomas
9eb75c7eba
list media uploads by session
2023-04-20 01:40:36 -07:00
Brandon Thomas
75607b3c12
tests, aspath
2023-04-20 00:27:37 -07:00
Brandon Thomas
ce69b1b055
filesys crate cleanup
2023-04-20 00:18:29 -07:00
Brandon Thomas
9ee7fdbac5
move endpoint
2023-04-19 01:18:07 -07:00
Brandon Thomas
67e3ecebc1
Voice conversion model list endpoint
2023-04-19 00:43:27 -07:00
Brandon Thomas
52db0b7796
python3.6
2023-04-18 15:46:08 -07:00
Brandon Thomas
15fa5a2bee
update image
2023-04-18 15:44:58 -07:00
Brandon Thomas
32babc99f0
update image
2023-04-18 12:47:58 -07:00
Brandon Thomas
bdac796e51
update tt2 legacy inference to support docker, etc, unfront config
2023-04-18 12:37:30 -07:00
Brandon Thomas
18c50af218
Add "Deepfake CNN" level
2023-04-16 02:54:57 -07:00
Brandon Thomas
62cbde94bc
anderson cooper voice config
2023-04-15 23:43:54 -07:00
Brandon Thomas
b2f9b44e96
uncommitted changes
2023-04-15 23:36:26 -07:00
Brandon Thomas
6a48a5372c
fix arg
2023-04-13 16:58:26 -07:00
Brandon Thomas
1b0368664a
update image
2023-04-13 19:53:37 -04:00
Brandon Thomas
6a83524fd9
switch from 'onnx' to 'infer' for checking model integrity
2023-04-13 16:48:14 -07:00
Brandon Thomas
233247f3c0
config path
2023-04-13 15:59:16 -07:00
Brandon Thomas
60045a01d0
fix command
2023-04-13 13:33:57 -07:00
Brandon Thomas
dc5dfd9831
update docker image
2023-04-13 13:24:07 -07:00
Brandon Thomas
7b36fc0b98
Update model check command (so-vits-svc), upgrade easyenv
2023-04-13 12:52:18 -07:00
Brandon Thomas
92e1d10809
wip so-vits-svc
2023-04-12 02:53:57 -07:00
Brandon Thomas
4a486cedd2
add so-vits-svc download type
2023-04-10 01:39:54 -07:00
Brandon Thomas
004cde84a7
move enum
2023-04-09 23:03:15 -07:00
Brandon Thomas
61b74500d8
codegen, a few enums
2023-04-09 22:55:21 -07:00
Brandon Thomas
8285826ed0
move where config lives
2023-04-09 20:16:13 -07:00
Brandon Thomas
03d0110ee6
ml docker image
2023-04-09 23:02:57 -04:00
Brandon Thomas
34517fbaff
fix build errors
2023-04-09 19:18:07 -07:00
Brandon Thomas
839f7885fb
try another path
2023-04-09 02:58:23 -07:00
Brandon Thomas
cee3ffb217
fix docker env vars
2023-04-09 02:29:22 -07:00
Brandon Thomas
90198252b8
nltk env var
2023-04-09 02:24:41 -07:00
Brandon Thomas
165130321f
try setting cache dir with docker now
2023-04-09 02:10:34 -07:00
Brandon Thomas
061c2c7b07
try to move cache dir again
2023-04-09 01:46:37 -07:00
Brandon Thomas
413960b6cf
actually pass env to popen
2023-04-09 01:37:33 -07:00
Brandon Thomas
cc4b7deaa9
huggingface cache dir
2023-04-09 01:27:50 -07:00
Brandon Thomas
8229a3cfb3
record entity token/type after job completes
2023-04-08 22:59:16 -07:00
Brandon Thomas
b461c7e8e7
make field optional
2023-04-08 21:03:07 -07:00
Brandon Thomas
c58f23c117
fixup inference-job
2023-04-08 20:52:51 -07:00
Brandon Thomas
048cc26b6b
fixup storyteller-web
2023-04-08 20:50:22 -07:00
Brandon Thomas
9b5508d8c0
fixup mysql queries
2023-04-08 20:41:10 -07:00
Brandon Thomas
a81428913d
migrate generic_inference_jobs to include better indices/foreign keys
2023-04-08 19:54:58 -07:00
Brandon Thomas
756c8e09ae
inference status endpoints
2023-04-08 18:49:59 -07:00
Brandon Thomas
5b97360724
update upload routes
2023-04-08 01:09:22 -07:00
Brandon Thomas
79ad78bdde
header to route TT2 requests to new worker
2023-04-06 22:00:44 -07:00
Brandon Thomas
311299105b
updated docker image
2023-04-07 00:48:24 -04:00
Brandon Thomas
9dad3a153c
ml repo update
2023-04-06 22:50:21 -04:00
Brandon Thomas
93157b50c8
vits inference command roughly done, need to test
2023-04-06 18:58:07 -07:00
Brandon Thomas
47fbc1704d
analytics
2023-04-06 16:48:31 -07:00
Brandon Thomas
efba106d3c
analytics query
2023-04-06 16:26:06 -07:00
Brandon Thomas
e340eee250
progress on VITS (WIP)
2023-04-06 16:02:01 -07:00
Brandon Thomas
73be1bbf05
git rid of dated enum, start work on VITS inference
2023-04-06 14:35:29 -07:00
Brandon Thomas
81306d1a56
(untested) route VITS tts to generic job type
2023-04-05 01:48:50 -07:00
Brandon Thomas
8e341f7a83
strongly typed tts model type
2023-04-05 01:21:31 -07:00
Brandon Thomas
1978e5e653
db index on tts_models.tts_model_type
2023-04-05 00:53:52 -07:00
Brandon Thomas
8eaaad9b55
fix path error
2023-04-04 15:01:04 -07:00
Brandon Thomas
082c284add
debugging
2023-04-04 14:47:15 -07:00
Brandon Thomas
a83e5ff224
logging
2023-04-04 14:25:50 -07:00
Brandon Thomas
abaaaf2fdb
dev
2023-04-04 14:12:33 -07:00
Brandon Thomas
3409689566
fix path handling, introduce another (smaller scope) filesystem crate
2023-04-04 13:59:21 -07:00
Brandon Thomas
84c0e42964
fmt
2023-04-04 12:53:09 -07:00
Brandon Thomas
b848c2b549
update docker image for appropriate cuda version
2023-04-04 15:50:06 -04:00
Brandon Thomas
85abbd8587
set python intepreter, fix path
2023-04-04 03:14:40 -07:00
Brandon Thomas
b844191db7
downloader image
2023-04-04 06:08:19 -04:00
Brandon Thomas
0267a4799d
fix a few errors with paths and quoting
2023-04-04 03:07:54 -07:00
Brandon Thomas
c50060b161
no vits download venv
2023-04-04 02:57:39 -07:00
Brandon Thomas
a508a843bd
root dir
2023-04-04 02:56:25 -07:00
Brandon Thomas
d0bad0c8fb
docker image for testing
2023-04-04 05:50:48 -04:00
Brandon Thomas
d2c99a7bad
configure download-job for VITS (wip)
2023-04-04 00:24:28 -07:00
Brandon Thomas
681d923ae0
Add 'vits' enum to tts model tables
2023-04-04 00:11:48 -07:00
Brandon Thomas
9e563a0640
VITS download WIP (nearly done)
2023-04-03 23:41:18 -07:00
Brandon Thomas
db30096cb9
rename module in inference-job
2023-04-03 21:43:42 -07:00
Brandon Thomas
76f9f5a850
Refactor download job, begin to work on VITS downloading
2023-04-03 21:37:07 -07:00
Brandon Thomas
3a0eafee11
report back on how to handle the upload
2023-04-02 21:34:38 -07:00
Brandon Thomas
9fbecd5568
enqueue vits uploads (in theory)
2023-04-02 21:21:16 -07:00
Brandon Thomas
b3dedfc5a8
WIP VITS uploads
2023-04-02 21:05:05 -07:00
Brandon Thomas
8ded313e7b
configure storyteller-web with more db (why so slow in dev?!)
2023-04-02 20:23:12 -07:00
Brandon Thomas
e305928b45
flexible docker image sha
2023-04-02 20:01:45 -07:00
Brandon Thomas
db48ee0fd8
mac frontend cors
2023-04-01 05:40:25 -04:00
Brandon Thomas
5beedcb5e3
add one color
2023-03-25 23:12:14 -04:00
Brandon Thomas
e43feeb700
add random avatar/color to several endpoints
2023-03-25 19:54:12 -04:00
Brandon Thomas
38dc835ff4
add to event feed
2023-03-25 19:33:59 -04:00
Brandon Thomas
62b19b2b0e
functions to generate random avatar + color
2023-03-25 19:04:37 -04:00
Brandon Thomas
b7b92f4419
reduce user tokens to a single list
2023-03-23 02:49:33 -04:00
Brandon Thomas
7ee7ff3875
split ipv4/ipv6 files
2023-03-23 02:44:28 -04:00
Brandon Thomas
29237d3ead
user tokens
2023-03-23 02:42:05 -04:00
Brandon Thomas
5afbfc0ec4
change troll sequences
2023-03-23 02:32:05 -04:00
Brandon Thomas
6e5a2d1789
more accounts
2023-03-23 02:13:07 -04:00
Brandon Thomas
13281ea3b1
more accounts
2023-03-23 02:10:36 -04:00
Brandon Thomas
98f80a68de
documentation on removed ipv6 bans (in cloudflare, not our code)
2023-03-23 01:55:34 -04:00
Brandon Thomas
075fcfb81e
unblock ipv6
2023-03-23 01:42:27 -04:00
Brandon Thomas
a8c45cfac2
more accounts
2023-03-23 01:40:56 -04:00
Brandon Thomas
f0a4f0a4f7
more ips / accounts
2023-03-23 01:09:24 -04:00
Brandon Thomas
3b78853d7c
new user tokens and ip addresses
2023-03-23 01:03:58 -04:00
Brandon Thomas
98b6bb34a7
lighten up on the troll text
2023-03-23 01:02:18 -04:00
Brandon Thomas
4d759719f6
more IPs and user tokens
2023-03-23 00:52:41 -04:00
Brandon Thomas
ac28ff8a39
start blocking 101soundboards IPs too
2023-03-23 00:50:03 -04:00
Brandon Thomas
43a33a00ee
gitignore
2023-03-23 00:43:27 -04:00
Brandon Thomas
8bbc490b61
ignore vim temp files
2023-03-23 00:43:01 -04:00
Brandon Thomas
168a476b72
user token + ip address troll bans
2023-03-23 00:28:00 -04:00
Brandon Thomas
2cebfbb3fc
more 101soundboards user tokens
2023-03-23 00:12:44 -04:00
Brandon Thomas
d57e070c8c
dedup
2023-03-22 23:58:06 -04:00
Brandon Thomas
bde6b4d562
more user tokens
2023-03-22 23:56:12 -04:00
Brandon Thomas
9cde097d38
more stupid accounts
2023-03-22 23:53:13 -04:00
Brandon Thomas
1d7d1ba194
more 101soundboards user tokens
2023-03-22 23:50:36 -04:00
Brandon Thomas
632cf5a710
more 101soundboards user tokens
2023-03-22 23:40:19 -04:00
Brandon Thomas
c2e287f6f4
more damned accounts
2023-03-22 22:55:26 -04:00
Brandon Thomas
844799e30e
more 101soundboards accounts
2023-03-22 22:49:38 -04:00
Brandon Thomas
c1bd8ed611
actually fix builds
2023-03-22 19:57:04 -04:00
Brandon Thomas
1466bca4d7
fix build
2023-03-22 18:32:36 -04:00
Brandon Thomas
12fdf24028
temp disable build
2023-03-22 18:28:24 -04:00
Brandon Thomas
cefb770340
codegen db
2023-03-22 16:49:24 -04:00
Brandon Thomas
e971ea98dc
fix troll bans
2023-03-22 16:47:10 -04:00
Brandon Thomas
9ab8b366e9
ban 101 soundboards
2023-03-22 16:24:23 -04:00
Brandon Thomas
96563fa345
add a means to ban user tokens (or disable the service in weird ways)
2023-03-22 16:05:09 -04:00
Brandon Thomas
67ab94664c
working locally
2023-03-22 15:34:02 -04:00
Brandon Thomas
99f1226115
I have to run this under Docker locally since it's ancient
2023-03-21 05:35:08 -04:00
Brandon Thomas
9c45a17b8d
new inference subprocess command
2023-03-21 05:18:07 -04:00
Brandon Thomas
2cf5a6f942
TTS inference almost working on generic-inference-job
2023-03-21 02:01:13 -04:00
Brandon Thomas
071928d7bf
port more TT2 logic
2023-03-21 00:49:21 -04:00
Brandon Thomas
b8442b54ee
cleanup
2023-03-21 00:18:39 -04:00
Brandon Thomas
530d891ce9
about to bolt on TT2
2023-03-21 00:11:42 -04:00
Brandon Thomas
972f119468
query tts model
2023-03-20 23:57:44 -04:00
Brandon Thomas
9004432620
generic inference jobs can be listed (hacky fix)
2023-03-20 23:42:23 -04:00
Brandon Thomas
81a3bc270b
fix generic job list query
2023-03-20 23:11:38 -04:00
Brandon Thomas
84fe5a5762
enqueue generic inference jobs for tt2
2023-03-20 22:28:59 -04:00
Brandon Thomas
a02934ca4e
Add routing column to inference jobs (wip)
2023-03-20 21:58:08 -04:00
Brandon Thomas
4ddcd43e33
remove a lot of garbage from inference-job
2023-03-20 20:04:49 -04:00
Brandon Thomas
37be0174af
put inference job back into "working"(?) order
2023-03-20 19:29:06 -04:00
Brandon Thomas
f2e314d168
make sure this gets put in the image
2023-03-20 19:23:54 -04:00
Brandon Thomas
3bd216f00d
rename crate, fix path handling, move some env vars
2023-03-20 19:21:58 -04:00
Brandon Thomas
dc5885114d
env internal crate - search multiple directories for env files
2023-03-20 18:59:43 -04:00
Brandon Thomas
47873497b8
comment APIs needed disambiguation
2023-03-18 18:18:45 -04:00
Brandon Thomas
554766bd2a
Don't load IP ban sets that are empty
2023-03-18 13:25:14 -04:00
Brandon Thomas
86382bf219
rename files for better sorting
2023-03-18 13:13:54 -04:00
Brandon Thomas
59b1e28a14
unban IP
2023-03-18 13:12:52 -04:00
Brandon Thomas
3f88a741c9
private model logging + fix(?)
2023-03-18 13:06:19 -04:00
Brandon Thomas
2efcba5da6
fix broken path
2023-03-18 13:00:19 -04:00
Brandon Thomas
b4718a2f13
block broken python script IP 104.251.211.22
2023-03-18 12:59:19 -04:00
Brandon Thomas
efbb0000f3
fix list comment route
2023-03-18 07:02:50 -04:00
Brandon Thomas
0280e6b706
let's not do this table just yet
2023-03-18 05:37:14 -04:00
Brandon Thomas
79d568ee14
codegen db
2023-03-18 04:51:35 -04:00
Brandon Thomas
85630390a0
route bindings, list endpoint
2023-03-18 04:33:53 -04:00
Brandon Thomas
215b727bc1
create comment, delete comment handlers (not tested)
2023-03-18 03:54:30 -04:00
Brandon Thomas
e29c0b4c68
edit comment query
2023-03-18 02:13:46 -04:00
Brandon Thomas
c81e6af507
fix codegen script
2023-03-18 01:35:40 -04:00
Brandon Thomas
98d30917e5
rename crate 'database_queries' -> 'mysql_queries' because sqlite
2023-03-18 01:19:15 -04:00
Brandon Thomas
e62e409857
refactor package directory structure
2023-03-18 01:11:10 -04:00
Brandon Thomas
417137a9a8
deprecate some crates
2023-03-18 01:07:01 -04:00
Brandon Thomas
0da1994f0c
101soundboards user tokens
2023-03-18 00:45:33 -04:00
Brandon Thomas
36d016c3c7
todo
2023-03-17 09:34:58 -04:00
Brandon Thomas
b22e978e54
cleanup tts authorization logic
2023-03-17 08:52:04 -04:00
Brandon Thomas
c387f47c97
(untested) disallow use of private models unless owner
2023-03-17 08:34:15 -04:00
Brandon Thomas
1a09676327
codegen db
2023-03-17 07:57:50 -04:00
Brandon Thomas
e516f85e5f
filter out models that are private/hidden
2023-03-17 07:54:57 -04:00
Brandon Thomas
e16b86d36e
analytics query for non-public tts models
2023-03-17 06:50:06 -04:00
Brandon Thomas
003a86cd31
delete comments
2023-03-17 06:42:04 -04:00
Brandon Thomas
ebf48e20be
list comments endpoint
2023-03-16 12:21:28 -04:00
Brandon Thomas
df2444ddc0
insert comment
2023-03-16 11:09:26 -04:00
Brandon Thomas
6b6a2ceeba
codegen
2023-03-16 10:42:46 -04:00
Brandon Thomas
80da0d9649
Add tts result audio path to result endpoint
2023-03-16 10:31:28 -04:00
Brandon Thomas
b8fd0486c7
Untested query for inserting audit log items
2023-03-16 10:25:47 -04:00
Brandon Thomas
12ffb2ded1
new token types: comments, audit logs
2023-03-16 09:36:13 -04:00
Brandon Thomas
f810256b9c
new table enums
2023-03-16 09:28:49 -04:00
Brandon Thomas
461030b681
new tables (WIP) for comments + voice survey
2023-03-16 09:03:56 -04:00
Brandon Thomas
a33ff3f060
20 trending english voices
2023-03-16 09:02:43 -04:00
Brandon Thomas
98736324dc
25 trending english voices
2023-03-16 09:01:57 -04:00
Brandon Thomas
89a6f36f1a
gitignore for windows
2023-03-13 20:33:31 -04:00
Brandon Thomas
ac5bcbdd16
aichatbot: handler for current level
2023-03-13 18:27:25 -04:00
Brandon Thomas
7566c0d71c
use strum and default for more maintainable options
2023-03-13 18:20:58 -04:00
Brandon Thomas
0ca007b6e7
add level option for AiChatbotSidecar
2023-03-13 18:09:28 -04:00
Brandon Thomas
cbe07e2b3e
move test function out of aichatbot-sidecar
2023-03-13 17:50:04 -04:00
Brandon Thomas
495c01c38c
Merge pull request #40 from storytold/bt-cache-session
...
cache sessions + purge cache on billing, edit profile, etc.
2023-03-12 05:19:28 -04:00
Brandon Thomas
ff22319c77
purge session cache with billing endpoints
2023-03-12 05:17:37 -04:00
Brandon Thomas
16f2d5557b
clear session cache when user is edited
2023-03-12 04:49:59 -04:00
Brandon Thomas
e5cdb84c52
correct cache key
2023-03-12 04:34:50 -04:00
Brandon Thomas
8079be9f7e
progress with generics
2023-03-12 04:25:44 -04:00
Brandon Thomas
2821240cc0
generic over executor types
2023-03-12 04:12:22 -04:00
Brandon Thomas
ae0522419a
this *should* work - need to work on non-pooled version
2023-03-12 03:11:33 -04:00
Brandon Thomas
46bb4274ca
work in progress session caching (redis)
2023-03-12 03:00:47 -04:00
Brandon Thomas
f2b6dc4349
Merge pull request #39 from storytold/bt-redis-cache-endpoint
...
Bt redis cache endpoint
2023-03-12 01:25:31 -05:00
Brandon Thomas
a395c04265
Delete cache when tts model is edited
2023-03-12 01:24:23 -05:00
Brandon Thomas
d3a4613cc9
cleanup closures, fail open to db
2023-03-12 00:04:25 -05:00
Brandon Thomas
bdca25cf4f
cache works!
2023-03-11 23:58:14 -05:00
Brandon Thomas
06a053b6d9
this compiles too
2023-03-11 23:43:39 -05:00
Brandon Thomas
4104ef0129
this compiles too
2023-03-11 23:33:29 -05:00
Brandon Thomas
0f076cbacd
work in progress redis caching (this compiles)
2023-03-11 23:21:39 -05:00
Brandon Thomas
817b2c01df
new redis ttl cache crate (untested)
2023-03-11 22:53:01 -05:00
Brandon Thomas
c06c47f02e
Merge pull request #38 from storytold/bt-fix
...
Bt fix
2023-03-11 21:57:42 -05:00
Brandon Thomas
23b0dafd6b
fix compile errors
2023-03-11 21:57:13 -05:00
Brandon Thomas
91e83c8b90
notes
2023-03-11 21:57:13 -05:00
Brandon Thomas
4a32ced9cd
Merge pull request #37 from storytold/cache-profiles-redis
...
cache user profiles with redis
2023-03-11 06:42:15 -05:00
Brandon Thomas
75014a673a
cache user profiles with redis
2023-03-11 06:41:51 -05:00
Brandon Thomas
52afa5462d
Merge pull request #36 from storytold/block-ips
...
block more IPs
2023-03-11 05:15:40 -05:00
Brandon Thomas
a826d54311
block more IPs
2023-03-11 05:15:09 -05:00
Brandon Thomas
4f38e4b20a
codegen
2023-03-11 03:44:54 -05:00
Brandon Thomas
6880efd2f0
Merge pull request #35 from storytold/bt-edit-mfactor
...
edit tts model m-factor (mods only)
2023-03-11 03:42:27 -05:00
Brandon Thomas
e372a4b5ec
edit tts model m-factor (mods only)
2023-03-11 03:41:59 -05:00
Brandon Thomas
f978f1b055
Merge pull request #34 from storytold/bt-inference-test-jobs
...
test requests bypass the model cache
2023-03-11 02:36:11 -05:00
Brandon Thomas
ee69e72661
test requests bypass the model cache
2023-03-11 02:35:50 -05:00
Brandon Thomas
6295fd9569
update queries codegen
2023-03-11 02:09:03 -05:00
Brandon Thomas
53d9d55036
re-build all the things
2023-03-11 01:13:39 -05:00
Brandon Thomas
7e236f1e81
tts job now conveys mel multiplier
2023-03-11 01:12:35 -05:00
Brandon Thomas
6b7370ee64
migrations for mel multiply factor
2023-03-10 23:49:52 -05:00
Brandon Thomas
406d2eb7af
rename paths
2023-03-10 05:54:56 -05:00
Brandon Thomas
1cfb3663e9
endpoint disablement filter allows adjustment of online endpoints
2023-03-10 05:50:00 -05:00
Brandon Thomas
aa24f781fb
remove old ip banlist filter
2023-03-10 04:33:22 -05:00
Brandon Thomas
3a2dad2027
more cleanup, organization, refactor
2023-03-10 03:08:29 -05:00
Brandon Thomas
814c04cdac
more cleanup
2023-03-10 02:59:54 -05:00
Brandon Thomas
c45a6da8a5
rid database_queries of container_common::anyhow_result
2023-03-10 02:55:57 -05:00
Brandon Thomas
a5b2028588
begin removing container_common stuff
2023-03-10 02:53:48 -05:00
Brandon Thomas
4a743bace1
New static IP filter + docker config includes
2023-03-10 02:45:36 -05:00
Brandon Thomas
5ef5d6832b
IP lists of attackers to ban
2023-03-10 02:28:35 -05:00
Brandon Thomas
0ebb1e398b
Directory to contain IP bans
2023-03-10 02:21:48 -05:00
Brandon Thomas
4be572c36b
refactor / organize top level directories
2023-03-10 02:13:16 -05:00
Brandon Thomas
97bea31b1d
load an entire directory of bans
2023-03-10 01:49:11 -05:00
Brandon Thomas
f3dd785331
load ip sets from file
2023-03-10 01:34:57 -05:00
Brandon Thomas
0d99c2fc08
new ip address filter middleware (wip)
2023-03-10 01:12:37 -05:00
Brandon Thomas
edba26a2db
cache leaderboard
2023-03-09 18:29:15 -05:00
Brandon Thomas
89a9448c9a
new caching logic for get pending tts counts
2023-03-09 18:16:02 -05:00
Brandon Thomas
d557c78123
new LRU cache to bypass expiry
2023-03-09 18:06:21 -05:00
Brandon Thomas
9ac7f33008
feature flag to control frontend tts queue refresh rate
2023-03-09 10:47:59 -05:00
Brandon Thomas
716e7923ff
Add IP addresses that attacked us
2023-03-09 02:19:51 -05:00
Brandon Thomas
ad389491a2
mark dummy service logs
2023-03-09 00:31:00 -05:00
Brandon Thomas
85b5e427b9
Wrap forwarded ip
2023-03-09 00:30:20 -05:00
Brandon Thomas
74d7b543f2
dummy service too
2023-03-08 21:10:09 -05:00
Brandon Thomas
2078bac70f
forwarded IP in logs
2023-03-08 21:09:47 -05:00
Brandon Thomas
2e0110b0d9
omfg I'm dumb
2023-03-08 20:49:59 -05:00
Brandon Thomas
80a32eedf3
default route
2023-03-08 20:37:54 -05:00
Brandon Thomas
539c5ae796
with and without compression (messy af hack)
2023-03-08 20:32:54 -05:00
Brandon Thomas
6440d519f9
build dummy service in docker image
2023-03-08 20:17:30 -05:00
Brandon Thomas
690f4f1064
dummy service for debugging
2023-03-08 20:16:35 -05:00
Brandon Thomas
a1e4ca35cd
configurable health check duration
2023-03-08 18:49:56 -05:00
Brandon Thomas
d93c0a5a8d
log dropped requests
2023-03-08 17:10:36 -05:00
Brandon Thomas
9cc5ce9a04
faster builds for outage
2023-03-08 16:53:15 -05:00
Brandon Thomas
202b6c4a97
always opt in health checkers
2023-03-08 16:32:09 -05:00
Brandon Thomas
71abf1caa2
fix the pushback filter for the global GKE load balancer
2023-03-08 15:31:52 -05:00
Brandon Thomas
de01d0fde7
protect another endpoint (tts model list) with flag
2023-03-08 15:10:57 -05:00
Brandon Thomas
bb5ef2a3fe
404 "None" job statuses from broken Python clients
2023-03-08 14:53:14 -05:00
Brandon Thomas
a8ab9c1265
Middleware to disable site with 429 global pushback
2023-03-08 14:44:08 -05:00
Brandon Thomas
2412e15868
add a followup github action step
2023-03-08 12:48:12 -05:00
Brandon Thomas
4b45924455
one more disk space report
2023-03-08 12:30:06 -05:00
Brandon Thomas
72ce767337
bump github actions caching plugin
2023-03-08 12:28:06 -05:00
Brandon Thomas
76c562bf2e
trying one more thing
2023-03-08 12:24:37 -05:00
Brandon Thomas
6ac8759aba
remove check of filesystem at root due to permissions on /proc
2023-03-08 12:23:45 -05:00
Brandon Thomas
3503a4527c
disable docker container build tests (for now - emergency)
2023-03-08 12:23:04 -05:00
Brandon Thomas
03160b73d4
Merge pull request #33 from storytold/bt-space-check
...
report disk usage
2023-03-08 12:15:42 -05:00
Brandon Thomas
601b786b06
report disk usage
2023-03-08 12:15:25 -05:00
Brandon Thomas
05503512d8
Merge pull request #32 from storytold/bt-space
...
attempt to fix github builds failing for space issues
2023-03-08 11:48:02 -05:00
Brandon Thomas
7db6f074b6
attempt to fix github builds failing for space issues
2023-03-08 11:47:31 -05:00
Brandon Thomas
e7ad3a34de
Merge pull request #31 from storytold/bt-ff
...
feature flag to disable tts queue length
2023-03-08 11:28:13 -05:00
Brandon Thomas
5ccd512a2a
feature flag to disable tts queue length
2023-03-08 11:27:42 -05:00
Brandon Thomas
c40333e2a2
Fixup sqlx offline query caching, fix failing tests, fix docker
2023-03-08 05:56:59 -05:00
Brandon Thomas
edcfc9ff9b
port final storyteller-web query out: enqueue infer w2l
2023-03-08 05:31:56 -05:00
Brandon Thomas
862be58f1a
port "assign/unassign tts category" out of storyteller-web
2023-03-08 05:14:34 -05:00
Brandon Thomas
8b08f2ba1d
port "edit w2l template" queries out of storyteller-web
2023-03-08 05:01:49 -05:00
Brandon Thomas
fe3f8dec6c
port "edit w2l result" queries
2023-03-08 03:30:09 -05:00
Brandon Thomas
8ae5d34074
port the two "edit tts result" queries
2023-03-08 03:14:54 -05:00
Brandon Thomas
89f8837706
port tts upload job status query
2023-03-08 01:05:35 -05:00
Brandon Thomas
03ed0b4c7b
analytics queries
2023-03-07 23:57:43 -05:00
Brandon Thomas
f1d8161481
port get pending w2l detailed stats out of storyteller-web
2023-03-06 20:03:43 -05:00
Brandon Thomas
2d20430f55
port tts inference stats from storyteller web
2023-03-06 19:56:26 -05:00
Brandon Thomas
e2b98491cb
port storyteller-web query: insert w2l template upload job
2023-03-06 19:21:14 -05:00
Brandon Thomas
910caa1000
port storyteller-web get w2l inference job status
2023-03-06 18:58:15 -05:00
Brandon Thomas
0e39999097
port query get upload w2l template status
2023-03-06 06:03:59 -05:00
Brandon Thomas
77779bc231
port insert tts upload job query
2023-03-06 05:47:51 -05:00
Brandon Thomas
898c22b9cc
port "edit category" out of storyteller-web
2023-03-06 05:28:17 -05:00
Brandon Thomas
96b80b35a5
port query: set w2l template mod approval
2023-03-06 05:16:22 -05:00
Brandon Thomas
d182f800f7
port query: inference job status
2023-03-06 05:07:43 -05:00
Brandon Thomas
60af92ea39
port storyteller-web query: pending w2l template list
2023-03-06 04:57:45 -05:00
Brandon Thomas
da8c164b40
port storyteller-web query: create category
2023-03-06 04:49:36 -05:00
Brandon Thomas
d304f40984
port useless query - should have just deleted this one
2023-03-06 04:41:05 -05:00
Brandon Thomas
8f0d347c38
move storyteller-web query: set user role
2023-03-06 04:27:34 -05:00
Brandon Thomas
73db1b1a49
move another storyteller web query: category soft delete
2023-03-06 04:18:58 -05:00
Brandon Thomas
97b7120ff8
move another storyteller-web query: ban user
2023-03-06 04:07:46 -05:00
Brandon Thomas
961c5cf43d
remove another storyteller-web query: upsert ip ban
2023-03-06 03:58:47 -05:00
Brandon Thomas
4c2c54bd74
Merge pull request #30 from storytold/bt-extract-queries
...
Bt extract queries
2023-03-06 02:05:03 -05:00
Brandon Thomas
c158097b42
move queries for public event feed out of storyteller-web
2023-03-06 02:01:46 -05:00
Brandon Thomas
1c9366da4b
remove another storyteller-web query : staff
2023-03-06 02:01:46 -05:00
Brandon Thomas
f648f7b714
port db query for toggle IP ban out of storyteller-web
2023-03-06 02:01:46 -05:00
Brandon Thomas
c3db6ce24a
remove another ip ban query from storyteller-web
2023-03-06 02:01:46 -05:00
Brandon Thomas
1910b6497c
get rid of storyteller-web list ip bans query
2023-03-06 02:01:46 -05:00
Brandon Thomas
ac90b89230
SQL codegen for MySQL + Sqlite
2023-03-02 05:46:53 -05:00
Brandon Thomas
70e6ba5aec
codegen db
2023-02-26 00:12:58 -05:00
Brandon Thomas
5af6a68de7
Random init news story progress - better for initial mix of stories
2023-02-24 04:21:26 -05:00
Brandon Thomas
19532388a3
work on selecting random stories to scrape
2023-02-24 04:05:03 -05:00
Brandon Thomas
27adc9f73e
gizmodo + kotaku in app scraping
2023-02-24 03:41:12 -05:00
Brandon Thomas
6d082f2b9e
Kotaku + Gizmodo RSS indexers
2023-02-24 03:18:00 -05:00
Brandon Thomas
2c86a4189c
kotaku scraper
2023-02-24 02:49:02 -05:00
Brandon Thomas
bf5b2b385e
CNN timestamps
2023-02-24 02:33:37 -05:00
Brandon Thomas
b7c73930b4
CNN timestamps
2023-02-24 02:20:36 -05:00
Brandon Thomas
f9d61a1482
Gizmodo scraper
2023-02-24 01:50:08 -05:00
Brandon Thomas
4799d3ceac
CBS News scraper
2023-02-24 01:21:29 -05:00
Brandon Thomas
696fd2bd8d
Add timestamp to theguardian scraper
2023-02-24 00:45:10 -05:00
Brandon Thomas
1cfb3bb715
TheGuardian scraper
2023-02-23 19:21:19 -05:00
Brandon Thomas
ccb36f7f6e
CLI utility to test parsing
2023-02-23 18:57:23 -05:00
Brandon Thomas
83a16f83e3
fix builds?
2023-02-23 17:19:16 -05:00
Brandon Thomas
8f9554be9f
try to fix builds again
2023-02-23 05:10:10 -05:00
Brandon Thomas
d987397586
fix builds?
2023-02-23 02:54:29 -05:00
Brandon Thomas
41e03feb85
more analytics queries
2023-02-23 02:15:04 -05:00
Brandon Thomas
5c8cab0d90
extra analysis query
2023-02-23 01:35:03 -05:00
Brandon Thomas
8f40db9a3e
return short news title in HTTP endpoint
2023-02-22 08:36:18 -05:00
Brandon Thomas
b0a7c953be
Try to remove stories that have TTS strokes
2023-02-22 08:29:06 -05:00
Brandon Thomas
a08bc3fa64
include outputs in table, cleanup bugs
2023-02-22 07:51:53 -05:00
Brandon Thomas
5d111f0a68
fix job queue state flow
2023-02-22 07:35:45 -05:00
Brandon Thomas
51a5571d84
new jobs: LLM title summary, LLM categorization
2023-02-22 07:28:04 -05:00
Brandon Thomas
95f2ec3e40
Add new status columns to list queries
2023-02-22 06:02:10 -05:00
Brandon Thomas
b511420c03
Refactor to group news story tasks by phase
2023-02-22 05:14:07 -05:00
Brandon Thomas
aeab9da077
Summary news title and categories DB migrations
2023-02-22 04:57:05 -05:00
Brandon Thomas
46452415fd
hanashi v3
2023-02-21 23:06:42 -05:00
Brandon Thomas
cecbc8e730
report headline image url
2023-02-20 05:41:59 -05:00
Brandon Thomas
1ba73c817c
Avoid empty scraped articles
2023-02-20 05:37:59 -05:00
Brandon Thomas
8395739500
save debugging info
2023-02-20 05:23:07 -05:00
Brandon Thomas
c537f09c8f
Image generation works!
2023-02-20 05:09:35 -05:00
Brandon Thomas
1e7de6bf36
hanashi v2, include cnn entertainment feed
2023-02-19 06:35:22 -05:00
Brandon Thomas
ab6e3ceb5a
get rid of ads
2023-02-19 06:21:11 -05:00
Brandon Thomas
896938b762
begin work on per-website greenlighting
2023-02-19 06:05:48 -05:00
Brandon Thomas
486960905d
Add web_content_type to news_stories and news_story_productions
2023-02-19 05:57:36 -05:00
Brandon Thomas
2a54d3aac9
switch voices at runtime
2023-02-18 06:58:13 -05:00
Brandon Thomas
10ac9fee82
GUI dropdown (non-functional), window size
2023-02-18 06:38:59 -05:00
Brandon Thomas
cab4840a61
Sigil value in API for UNREAL's sake. Ugh.
2023-02-18 03:04:07 -05:00
Brandon Thomas
68a3c123eb
Include all news stories if "recent" is an empty list
2023-02-18 01:19:41 -05:00
Brandon Thomas
582ce9aa93
more debugging
2023-02-18 01:13:27 -05:00
Brandon Thomas
eaeb864c1c
debugging for endpoints
2023-02-16 05:56:05 -05:00
Brandon Thomas
77d4bc3b75
working retry
2023-02-16 04:50:51 -05:00
Brandon Thomas
b6be95144c
FakeYou with backoff
2023-02-16 04:40:24 -05:00
Brandon Thomas
5ca4dd3600
use session cookie credentials instead, because API sessions broken
2023-02-16 03:53:00 -05:00
Brandon Thomas
294c3107b5
API token for channels
2023-02-16 02:41:45 -05:00
Brandon Thomas
2de7ce146f
increase sqlite "connections"(??) to improve performance
2023-02-16 02:28:53 -05:00
Brandon Thomas
f7ddd24325
Get next audio file in sequence
2023-02-16 02:26:48 -05:00
Brandon Thomas
1b1ed15f21
endpoint for random news story
2023-02-15 04:55:46 -05:00
Brandon Thomas
dc93602306
track audio durations in db
2023-02-15 04:04:21 -05:00
Brandon Thomas
2898f40ad1
Fix errors
2023-02-15 03:34:27 -05:00
Brandon Thomas
ced51c7f58
track extra metadata throughout production
2023-02-15 03:20:38 -05:00
Brandon Thomas
b208847ec8
insert news story, tighten up timings
2023-02-15 02:48:15 -05:00
Brandon Thomas
744656cfd9
remove imgui (we're not using it)
2023-02-15 01:33:22 -05:00
Brandon Thomas
a735d3e972
sequence length
2023-02-15 01:24:16 -05:00
Brandon Thomas
90aa091398
refactor tts_render_targets -> tts_render_tasks
2023-02-15 01:12:58 -05:00
Brandon Thomas
f8e7ae3ced
preproduction story finalization
2023-02-14 13:09:22 -05:00
Brandon Thomas
a1b8a22225
Download files
2023-02-14 12:47:23 -05:00
Brandon Thomas
0a0105410d
Get updated audio status
2023-02-14 05:13:57 -05:00
Brandon Thomas
69a79b76ea
seems to work better?
2023-02-14 04:26:53 -05:00
Brandon Thomas
809387958c
cleanup
2023-02-14 03:29:46 -05:00
Brandon Thomas
44f7824910
cleanup
2023-02-14 02:59:29 -05:00
Brandon Thomas
1e05dcb7e2
Add sequence order
2023-02-14 02:47:07 -05:00
Brandon Thomas
72bdea7d10
Record inference details
2023-02-14 02:22:00 -05:00
Brandon Thomas
c3981e8554
idempotency crate, FakeYou requests to infer work
2023-02-14 02:03:31 -05:00
Brandon Thomas
6b937b7cd0
FakeYou rendering *almost* works
2023-02-14 01:37:26 -05:00
Brandon Thomas
5be10ae87a
refactor/organize worker modules
2023-02-13 21:32:46 -05:00
Brandon Thomas
12f7e30047
fakeyou client
2023-02-13 21:25:43 -05:00
Brandon Thomas
a5e0c2ab01
reorganize analytics queries
2023-02-13 17:39:58 -05:00
Brandon Thomas
0764711439
pause controls for scraping
2023-02-13 17:12:12 -05:00
Brandon Thomas
969be4726c
easier concurrency atomic bools, add controls for pieces
2023-02-13 17:05:22 -05:00
Brandon Thomas
8244bac6e1
tweak timings
2023-02-13 04:52:41 -05:00
Brandon Thomas
1d173a74d5
split into paragraph heuristic
2023-02-13 04:34:24 -05:00
Brandon Thomas
3786a64eb1
text splitting
2023-02-13 03:49:01 -05:00
Brandon Thomas
cc6cf0d6c0
"add dragon", as old colleagues would say
...
Maybe one day we can afford to buy Nintendo. (That's crazy.)
2023-02-12 22:53:56 -05:00
Brandon Thomas
144df6ffc0
refactor to make llm rendition a part of production flow
2023-02-12 17:52:18 -05:00
Brandon Thomas
85e0ce4b4a
Greenlighting stories + production workflow (abstract, but will use)
2023-02-12 15:54:26 -05:00
Brandon Thomas
107d11f0f9
Analysis of paying subscribers
2023-02-12 02:40:11 -05:00
Brandon Thomas
7efb65ae08
new tables
2023-02-10 21:26:14 -05:00
Brandon Thomas
ba3ff9768a
WIP - tables for stories
2023-02-10 06:28:55 -05:00
Brandon Thomas
b8e37d2e77
mark jobs done
2023-02-10 03:49:45 -05:00
Brandon Thomas
5a1e61b692
add some filters
2023-02-10 01:16:51 -05:00
Brandon Thomas
19b57b9c1d
unused module
2023-02-10 00:41:57 -05:00
Brandon Thomas
6c33c31289
skip CNN video content
2023-02-08 05:13:45 -05:00
Brandon Thomas
b1bbfe21ec
OpenAI API calls
2023-02-08 03:36:41 -05:00
Brandon Thomas
5878224f7e
rendition schema
2023-02-07 22:40:35 -05:00
Brandon Thomas
5497b7c0aa
small refactor
2023-02-07 18:54:23 -05:00
Brandon Thomas
bc58b50408
shared title/image extractors
2023-02-07 17:50:58 -05:00
Brandon Thomas
ce17a3e1bf
CNN articles, shared extractors
2023-02-07 17:13:07 -05:00
Brandon Thomas
b8fe3a0e7d
fix pagination bugs
2023-02-07 03:04:04 -05:00
Brandon Thomas
d41cec6c90
cleanup log spam
2023-02-07 02:24:44 -05:00
Brandon Thomas
6a86f43a92
scraping appears to work
2023-02-07 02:18:00 -05:00
Brandon Thomas
65a7a46914
finish refactoring macros
2023-02-06 23:53:19 -05:00
Brandon Thomas
31eafed60d
refactor database enum macros
2023-02-06 23:51:30 -05:00
Brandon Thomas
6abbbaae01
list query, enum macros for web_scraping_targets (sqlite)
2023-02-06 23:46:22 -05:00
Brandon Thomas
82efbf4d1f
update docs
2023-02-06 22:10:12 -05:00
Brandon Thomas
b1cefa66d5
docs about windows setup
2023-02-06 22:09:03 -05:00
Brandon Thomas
7f5f578abd
ignore this mess
2023-02-06 21:58:47 -05:00
Brandon Thomas
0c574c31d6
update path
2023-02-06 18:42:31 -05:00
Brandon Thomas
393bc084d4
scope aichatbot to sqlite
2023-02-06 18:38:33 -05:00
Brandon Thomas
035faa0561
update launch script
2023-02-06 17:56:32 -05:00
Brandon Thomas
84e2bcd2c3
sqlite library for windows
2023-02-06 16:37:12 -05:00
Brandon Thomas
bc69ecbda5
start script for windows
2023-02-06 16:17:16 -05:00
Brandon Thomas
5f35323a5f
fixes for windows
2023-02-06 16:14:24 -05:00
Brandon Thomas
30c9f779bd
outline remaining work
2023-02-06 05:00:32 -05:00
Brandon Thomas
4f7d03a505
index cnn + techcrunch
2023-02-06 04:56:49 -05:00
Brandon Thomas
5a031b1b80
indexer flow
2023-02-06 04:49:28 -05:00
Brandon Thomas
d1b6facd95
worker threads
2023-02-06 04:46:10 -05:00
Brandon Thomas
79984058c0
Save webpage and scraping summary
2023-02-06 03:56:51 -05:00
Brandon Thomas
adc52cd01e
directory to persist html
2023-02-06 03:32:07 -05:00
Brandon Thomas
aad257a1b2
fully refactor "hashing" out of container_common
2023-02-06 03:18:53 -05:00
Brandon Thomas
b8d5a1fad1
hashing refactor
2023-02-06 03:06:01 -05:00
Brandon Thomas
f757b94eaf
refactor "hashing"
2023-02-06 03:02:23 -05:00
Brandon Thomas
8ff2408cbf
begin to work on persisting scraping
2023-02-06 02:47:21 -05:00
Brandon Thomas
01fa2f8d67
serde
2023-02-05 17:35:44 -05:00
Brandon Thomas
25b7024655
title, more fields
2023-02-05 17:32:29 -05:00
Brandon Thomas
f7b8423623
techcrunch parsing sort of works
2023-02-05 16:29:17 -05:00
Brandon Thomas
0f99360c20
the guardian
2023-02-05 05:54:25 -05:00
Brandon Thomas
fe606c1610
three techcrunch feeds
2023-02-05 05:28:39 -05:00
Brandon Thomas
201481f969
handle TechCrunch venture feed
2023-02-05 05:24:54 -05:00
Brandon Thomas
665cd83739
techcrunch scraping of RSS feed
2023-02-05 05:12:42 -05:00
Brandon Thomas
eefe48f8ca
CNN candidate articles via RSS + Sqlite inserts
2023-02-05 05:02:13 -05:00
Brandon Thomas
a1c5ef6eb2
add sqlite columns, move database
2023-02-05 03:44:02 -05:00
Brandon Thomas
2f4fe2dabc
Web scraping WIP
2023-02-05 03:36:17 -05:00
Brandon Thomas
d63a505b8b
comments in .gitignore, aichatbot diesel configs
2023-02-05 01:41:08 -05:00
Brandon Thomas
fb1bf9940e
move migrations dir
2023-02-05 01:32:34 -05:00
Brandon Thomas
d4de388bb6
new reserved usernames for channels
2023-02-05 01:21:57 -05:00
Brandon Thomas
a0a5c68086
Project outline
2023-02-04 18:24:45 -05:00
Brandon Thomas
ddb106a9af
reqwest, ingestion modules (wip)
2023-02-03 23:57:12 -05:00
Brandon Thomas
7c229ba59b
fix
2023-02-03 06:00:21 -05:00
Brandon Thomas
d1978298f0
unixy paths
2023-02-03 05:57:41 -05:00
Brandon Thomas
1dcf06b571
fix?
2023-02-03 05:50:37 -05:00
Brandon Thomas
8af2368f32
fix?
2023-02-03 05:46:29 -05:00
Brandon Thomas
79fba33aae
more debugging
2023-02-03 05:44:38 -05:00
Brandon Thomas
bff0f9181d
debugging
2023-02-03 05:42:27 -05:00
Brandon Thomas
bd8f2570e2
report audio filename
2023-02-03 05:37:29 -05:00
Brandon Thomas
74c289b338
refactor sidecar, save dir
2023-02-03 05:17:09 -05:00
Brandon Thomas
63bb0e7253
cursor
2023-02-03 03:45:17 -05:00
Brandon Thomas
4140d07924
OpenAI API calls
2023-02-03 02:09:55 -05:00
Brandon Thomas
aa03abd3b5
Merge pull request #28 from storytold/saj-unsubscribe-reason
...
endpoint for indicating why a user is unsubscribing
2023-02-03 01:33:54 -05:00
Paul Sajna
fb8142fb49
endpoint for indicating why a user is unsubscribing
2023-02-02 22:25:00 -08:00
Brandon Thomas
362f41cbf3
Webserver + Egui synced
2023-02-02 17:55:04 -05:00
Brandon Thomas
a79d3bcf9a
fix windows builds?
2023-02-02 16:17:01 -05:00
Brandon Thomas
41e7780fa0
fix builds ?
2023-02-02 15:57:22 -05:00
Brandon Thomas
329e7defc5
update paths
2023-02-02 15:54:41 -05:00
Brandon Thomas
6ce0437aa2
ignore some code from Github language statistics
2023-02-02 15:52:33 -05:00
Brandon Thomas
34bb2c5266
ACTUALLY YOU CAN LAUNCH ACTIX FROM ANOTHER THREAD
2023-02-02 15:41:56 -05:00
Brandon Thomas
2b50d2bce5
new lib: actix_helpers (RouteBuilder), --gui, etc.
2023-02-02 15:33:01 -05:00
Brandon Thomas
c9f55fbb7c
Still issues with launching a gui on non-main thread; add fonts
2023-02-02 12:22:53 -05:00
Brandon Thomas
2da4971ec7
analytics query adjustments
2023-02-02 11:56:53 -05:00
Brandon Thomas
2cd6a98259
egui wants to run on main thread; so does actix. ugh
2023-02-02 04:38:43 -05:00
Brandon Thomas
7ba765b89c
Setting up aichatbot-sidecar desktop program
2023-02-02 01:40:44 -05:00
Brandon Thomas
02d7495e54
kick this can down the road _again_
2023-02-02 00:43:59 -05:00
Brandon Thomas
088535cb5a
refactor/move "plugins" crate to pertain only to services
2023-02-02 00:40:01 -05:00
Brandon Thomas
4ef9ad35a7
fix migration dir config
2023-02-02 00:30:30 -05:00
Brandon Thomas
f80f2c8962
Move all SQL stuff into single directory
2023-02-01 23:53:49 -05:00
Brandon Thomas
98fb5758e5
I'll see myself out
2023-02-01 19:32:03 -05:00
Brandon Thomas
06f219a8af
more reserved names
2023-02-01 19:30:30 -05:00
Brandon Thomas
439527a504
more reserved words
2023-02-01 19:26:00 -05:00
Brandon Thomas
61e1cc62b6
analytics query
2023-01-30 01:20:06 -05:00
Brandon Thomas
633dfb5682
more queries
2023-01-29 20:58:03 -05:00
Brandon Thomas
8df0273ca8
more analysis
2023-01-29 20:17:50 -05:00
Brandon Thomas
41630e1fc5
paying user analytics
2023-01-29 20:09:28 -05:00
Brandon Thomas
40bc0cf883
never need 500 voices in analytics
2023-01-27 02:33:00 -05:00
Brandon Thomas
7fdb5cfe9c
codegen db
2023-01-26 01:17:27 -05:00
Brandon Thomas
a0da010dab
Add model ratings to TTS list and get endpoints
2023-01-26 01:12:20 -05:00
Brandon Thomas
74ff632f4d
update TTS statistics on model rate
2023-01-26 01:12:20 -05:00
Brandon Thomas
e6d1f0db11
Alter tts_models to add ratings counts
2023-01-26 01:12:20 -05:00
Brandon Thomas
d190173f4d
new queries
2023-01-25 16:29:25 -05:00
Brandon Thomas
22e8a14170
Fix build errors and mistakes with user ratings
2023-01-25 16:24:44 -05:00
Brandon Thomas
b6fce130b5
GET and POST endpoints for user ratings
2023-01-25 16:08:22 -05:00
Brandon Thomas
1bb0dda330
Rating type instead of bool, upsert query, enums
2023-01-25 02:33:56 -05:00
Brandon Thomas
bcbb36a9ed
User ratings table
2023-01-25 00:47:35 -05:00
Brandon Thomas
dbfd80531d
analytics query
2023-01-23 23:21:44 -05:00
Brandon Thomas
4152b346c1
Server info endpoint to report backend SHA
2023-01-21 03:17:49 -05:00
Brandon Thomas
3b37cf9e89
analytics query
2023-01-20 06:22:40 -05:00
Brandon Thomas
c49bbd299a
analytics queries for category assignments
2023-01-20 05:42:54 -05:00
Brandon Thomas
993fe647b4
remove whitespace from TTS model titles
2023-01-20 03:27:39 -05:00
Brandon Thomas
d46778569c
Add Arabic and Turkish language support (serverside)
2023-01-20 03:25:17 -05:00
Brandon Thomas
2ea0e1450c
Sort tts models returned by category membership endpoint
2023-01-18 01:01:29 -05:00
Brandon Thomas
b31bafd639
split up heavy category endpoint into modules
2023-01-17 23:58:53 -05:00
Brandon Thomas
9246ab83cf
sort models in category flag
2023-01-17 21:39:23 -05:00
Brandon Thomas
93b06bd8b5
rename synthetic categories
2023-01-17 21:32:22 -05:00
Brandon Thomas
271bce9815
fix trending voices with hack
2023-01-17 07:28:10 -05:00
Brandon Thomas
f0bebc6135
ugh, docker typo
2023-01-17 06:39:00 -05:00
Brandon Thomas
98ce37d9a4
re-codegen db
2023-01-17 05:55:29 -05:00
Brandon Thomas
b0bc019db2
Merge pull request #27 from storytold/bt-trending-voices
...
Bt trending voices
2023-01-17 05:50:22 -05:00
Brandon Thomas
f3c34d9a7b
Trending voices / job
2023-01-17 05:49:23 -05:00
Brandon Thomas
98c8bbda57
Trending voices / analytics table
2023-01-16 16:28:17 -05:00
Brandon Thomas
18b20d6c4d
cleanup analytics queries
2023-01-16 16:15:42 -05:00
Brandon Thomas
11fd4881ea
re-codegen
2023-01-16 04:57:25 -05:00
Brandon Thomas
7ab39d0b5c
Merge pull request #26 from storytold/bt-categories
...
Work on synthetic categories; "latest models" category
2023-01-16 04:22:39 -05:00
Brandon Thomas
77e16d4bd8
synthetic categories
2023-01-16 04:21:19 -05:00
Brandon Thomas
58c7695a2a
Refactor enums
2023-01-16 01:56:38 -05:00
Brandon Thomas
140c93fc76
Work on categories
2023-01-16 01:37:24 -05:00
Brandon Thomas
2b58e3c32d
Emit server build SHA from /_status endpoint
2023-01-15 01:40:58 -05:00
Brandon Thomas
142adf10ee
ugh, that was stupid af
2023-01-15 01:24:39 -05:00
Brandon Thomas
d1698ead1d
fix build arg?
2023-01-15 01:24:03 -05:00
Brandon Thomas
2909e2dbb4
reintroduce GIT_SHA to container
2023-01-14 22:42:09 -05:00
Brandon Thomas
9015efdf9e
real world language header test
2023-01-14 20:20:41 -05:00
Brandon Thomas
2a5634503f
Reorganize tts category handlers
2023-01-14 19:07:57 -05:00
Brandon Thomas
623b82dd0e
fix accept-language for q-factor
2023-01-14 06:54:34 -05:00
Brandon Thomas
9fbafd7fcd
sqlx 0.4.x -> 0.6.x
2023-01-14 06:39:28 -05:00
Brandon Thomas
cc573fe242
return even less nonessential data
2023-01-14 04:32:07 -05:00
Brandon Thomas
c4225ce571
Cache computed TTS category assignments
2023-01-14 04:29:48 -05:00
Brandon Thomas
2f6747b98a
Merge pull request #25 from storytold/bt-serverside-category-memberships
...
Compute and cache TTS model category assignments serverside
2023-01-14 00:17:03 -05:00
Brandon Thomas
bc5090af54
Compute and cache TTS model category assignments serverside
2023-01-14 00:13:27 -05:00
Brandon Thomas
8062833e8d
gzip response payloads
2023-01-12 05:36:14 -05:00
Paul Sajna
e5a852acd6
remove rustup override from ci
2023-01-11 18:35:35 -08:00
Brandon Thomas
84ccda1960
default rustup to 1.66
2023-01-11 06:51:06 -05:00
Brandon Thomas
893a861d22
Bump to trigger rebuild (to test build caching)
2023-01-11 06:19:43 -05:00
Brandon Thomas
13b014e7fc
bump rust version?
2023-01-11 05:17:41 -05:00
Brandon Thomas
c8598bc9e3
Merge pull request #24 from storytold/saj-ci
...
CI MVP
2023-01-11 04:40:22 -05:00
Brandon Thomas
ecf84c4b15
Fix codegen (for reals), notes for mac, perform codegen
2023-01-11 04:31:25 -05:00
Paul Sajna
c4ea221c50
test
2023-01-11 00:37:09 -08:00
Brandon Thomas
8de1722466
fix migration script
2023-01-11 03:22:58 -05:00
Paul Sajna
a716b8963f
;)
2023-01-11 00:09:39 -08:00
Paul Sajna
7f70de0148
???
2023-01-11 00:06:50 -08:00
Brandon Thomas
bc033c2202
Merge pull request #23 from storytold/brandon-web-vc
...
Web-based Voice Conversion Part 1
2023-01-11 03:06:15 -05:00
Paul Sajna
756c357462
attempt to hide brandon's crimes
2023-01-10 23:57:53 -08:00
Paul Sajna
4b8c454c84
getting there?
2023-01-10 23:42:23 -08:00
Paul Sajna
d2b3386fea
urggggghhhhhhhh
2023-01-10 23:39:47 -08:00
Paul Sajna
f458f29109
urgggggh
2023-01-10 23:38:15 -08:00
Paul Sajna
aa3faca551
another test
2023-01-10 23:36:50 -08:00
Paul Sajna
2512810e81
another test
2023-01-10 23:35:25 -08:00
Paul Sajna
db629a6a0d
WIP for testing if github actions has mysql
2023-01-10 23:33:48 -08:00
Brandon Thomas
30202e6e5a
Fix build errors. This is largely because inference_job is not done
2023-01-11 01:39:48 -05:00
Brandon Thomas
9a263a01a1
more reserved words
2023-01-11 00:33:40 -05:00
Brandon Thomas
85ae704ab5
more analytics queries
2023-01-11 00:33:40 -05:00
Brandon Thomas
b128cdb3f5
inference job handlers
2023-01-11 00:33:40 -05:00
Brandon Thomas
8755e7a533
generic inference job queries
2023-01-11 00:33:40 -05:00
Brandon Thomas
9f873c33e7
Begin refactor of generic inference-job
2023-01-11 00:33:40 -05:00
Brandon Thomas
81302d0e1d
Payload for voice conversion inference records
2023-01-11 00:33:40 -05:00
Brandon Thomas
9e589c2b72
Refactor - db enum types into enums crate
2023-01-11 00:33:40 -05:00
Brandon Thomas
7a33c0721a
enqueue webvc inference work
2023-01-11 00:33:40 -05:00
Brandon Thomas
e1793d71b5
enqueue voice conversion request handler, media synthetic ids, ...
2023-01-11 00:33:40 -05:00
Brandon Thomas
5b20710f96
Upload file to GCS bucket
2023-01-11 00:33:40 -05:00
Brandon Thomas
77e1319b81
'crockford' crate, use crockford entropy for bucket
2023-01-11 00:33:40 -05:00
Brandon Thomas
8061880a83
consolidate upload handling, use new bucket paths
2023-01-11 00:33:40 -05:00
Brandon Thomas
651ed42b64
New 'buckets' crate for cloud storage uploads
2023-01-11 00:33:40 -05:00
Brandon Thomas
e870d6f4de
rename storage_buckets_common crate -> cloud_storage
2023-01-11 00:33:40 -05:00
Brandon Thomas
16a2e765ca
Handle video formats, too
2023-01-11 00:33:40 -05:00
Brandon Thomas
ee7626602a
Calculate duration for audio files without metadata
2023-01-11 00:33:40 -05:00
Brandon Thomas
533cd5e051
Tests + test data for media uploads
2023-01-11 00:33:40 -05:00
Brandon Thomas
7f51ccd01b
file size bytes
2023-01-11 00:33:40 -05:00
Brandon Thomas
f2bfcfeb75
audio codec/encoding
2023-01-11 00:33:40 -05:00
Brandon Thomas
603a678378
new errors crate, cleanup media duration calculation
2023-01-11 00:33:40 -05:00
Brandon Thomas
1ba3215881
organize media/files crates
2023-01-11 00:33:40 -05:00
Brandon Thomas
c4c5b89118
Calculate audio duration millis
2023-01-11 00:33:40 -05:00
Brandon Thomas
9aaee506ed
hash uploaded file
2023-01-11 00:33:40 -05:00
Brandon Thomas
ff12990b01
sort _types crates at the top
2023-01-11 00:33:40 -05:00
Brandon Thomas
45b7af9bd2
detect upload mimetype
2023-01-11 00:33:39 -05:00
Brandon Thomas
a34aedc375
move sqlx impls to reusable macro
2023-01-11 00:33:39 -05:00
Brandon Thomas
cb1e092ccd
tests on derived Display/Debug
2023-01-11 00:33:39 -05:00
Brandon Thomas
07d13a4ab5
proper case for enum mysql insert
2023-01-11 00:33:39 -05:00
Brandon Thomas
43c890b27c
Hack for sqlx to insert enums into varchar, but case still wrong
2023-01-11 00:33:39 -05:00
Brandon Thomas
a1510d45b2
Media uploads "working" from frontend. Need to handle file + upload
2023-01-11 00:33:39 -05:00
Brandon Thomas
32c7354798
Get rid of super legacy CreatorSetVisibility
2023-01-11 00:33:39 -05:00
Brandon Thomas
31bb03d9d3
Sayonara, RecordVisibility
2023-01-11 00:33:39 -05:00
Brandon Thomas
66bb76e60f
Goodbye, 'EntityVisibility'
2023-01-11 00:33:39 -05:00
Brandon Thomas
68f2e46540
more tests on enum types
2023-01-11 00:33:39 -05:00
Brandon Thomas
d08d3cd543
New 'enums' crate for db "enum-like" fields, composite keys, etc.
...
This should be useful for:
- Actual enum fields
- Enum-like char/varchar fields
- Composite keys, polymorphic record behavior, etc.
This should also define how these values are returned over the HTTP API
2023-01-11 00:33:39 -05:00
Brandon Thomas
e7fc93de86
Mild refactor: tokens, reusable_types under types/ directory
2023-01-11 00:33:39 -05:00
Brandon Thomas
deb3671be6
Endpoint for audio uploading
2023-01-11 00:33:39 -05:00
Brandon Thomas
8591f74ff2
Look at "started" w2l jobs too
2023-01-11 00:33:39 -05:00
Brandon Thomas
26587e51e3
More "analytics" (more operational) queries for w2l jobs
2023-01-11 00:33:39 -05:00
Brandon Thomas
2fad965446
"analytics" query to soft delete tts results for a given model
2023-01-11 00:33:39 -05:00
Brandon Thomas
c2f4c2c057
Fix hifigan (softvc) model check
2023-01-11 00:33:39 -05:00
Brandon Thomas
51350e6e5c
default parameters for local download job
2023-01-11 00:33:39 -05:00
Brandon Thomas
5f598dc516
Fix download-job queries and compile errors
2023-01-11 00:33:39 -05:00
Brandon Thomas
7bcde1e490
queries to handle softvc download (insert)
2023-01-11 00:33:39 -05:00
Brandon Thomas
13d00f6edf
partially handle softvc model downloads
2023-01-11 00:33:39 -05:00
Brandon Thomas
91695cde00
downloader job: handle softvc hifigan
2023-01-11 00:33:39 -05:00
Brandon Thomas
91ac868369
new download types
2023-01-11 00:33:39 -05:00
Brandon Thomas
60af0ea36d
enum refactor, whew
2023-01-11 00:33:39 -05:00
Brandon Thomas
46280c7877
3x voice conversion tables (models, results, synthetic_ids)
2023-01-11 00:33:39 -05:00
Brandon Thomas
08c2736ea4
More new tables: media_uploads, audit_logs
2023-01-11 00:33:39 -05:00
Brandon Thomas
02bf8808d0
Web + Job queries for generic_inference_jobs
2023-01-11 00:33:39 -05:00
Brandon Thomas
1de10d1b9f
Move all service/web/job projects into grouped subdirectories by type
2023-01-11 00:33:39 -05:00
Brandon Thomas
b649bb17c5
Web Voice Conversion
2023-01-11 00:33:39 -05:00
Brandon Thomas
587ea70d33
Merge pull request #22 from storytold/sajattack-kubernetes-localdev
...
Kubernetes localdev
2023-01-10 22:17:23 -05:00
Paul Sajna
ffd7793a8d
Update local_development_k8s.md
2023-01-10 19:12:27 -08:00
Paul Sajna
6e13777e84
docs?
2023-01-10 18:59:01 -08:00
Paul Sajna
b7fd9aa8d1
x86_64-unknown-linux-musl compatibility and volume mount
2023-01-10 18:59:01 -08:00
Paul Sajna
26e91bd990
database migration bugfix
2023-01-10 18:59:01 -08:00
Paul Sajna
61d0cbd385
clean up something I was trying that I no longer need
2023-01-10 18:59:01 -08:00
Paul Sajna
28d7a26d97
storyteller-web api runs successfully
2023-01-10 18:59:01 -08:00
Brandon Thomas
4196a6499b
fix download url check
2022-12-19 19:14:19 -05:00
Brandon Thomas
2cf07c1346
Block uploads of invalid video urls for w2l
2022-12-19 18:02:30 -05:00
Brandon Thomas
f56ea64dce
automate ubuntu setup
2022-12-15 03:59:28 -05:00
Brandon Thomas
5cfb3f50d7
codegen db
2022-12-13 20:52:41 -05:00
Brandon Thomas
5e0851eb09
fix session / loyalty plan test; mark legacy tokens deprecated
2022-12-13 18:42:18 -05:00
Brandon Thomas
0d3ffd3f3b
use DownloadJobToken throughout codebase
2022-12-13 18:26:45 -05:00
Brandon Thomas
1b60427ab0
Add UserToken-specific tests so we have a backup in case the macro fails
2022-12-13 18:05:35 -05:00
Brandon Thomas
75ede876d5
More tests
2022-12-13 17:46:46 -05:00
Brandon Thomas
086980318c
use enum variants for prefixes
2022-12-13 17:08:12 -05:00
Brandon Thomas
c4ca48f399
prefix registry
2022-12-13 16:50:23 -05:00
Brandon Thomas
ad88800b4e
enum variants to control character set
2022-12-13 15:43:19 -05:00
Brandon Thomas
64e3864140
Macro-defined tests "kind of" work.
2022-12-13 15:32:23 -05:00
Brandon Thomas
81757870ab
Crockford constructor
2022-12-13 02:22:23 -05:00
Brandon Thomas
2769a0b3f9
macro to implement common string token methods
2022-12-13 01:27:29 -05:00
Brandon Thomas
89e721e3bc
derive serde traits
2022-12-13 00:20:49 -05:00
Brandon Thomas
353aa4211b
more tests
2022-12-13 00:16:44 -05:00
Brandon Thomas
422e36b405
add tests
2022-12-12 23:54:09 -05:00
Brandon Thomas
110c7f828f
simplify UserToken type as a wrapper type
2022-12-12 23:16:44 -05:00
Brandon Thomas
b9e2c87025
use UserToken in an existing flow
2022-12-12 22:44:04 -05:00
Brandon Thomas
b1d5244620
WIP tokens crate
2022-12-12 22:34:08 -05:00
Brandon Thomas
7bcb576436
also track subscription status
2022-12-07 18:09:13 -05:00
Brandon Thomas
2e561acbb4
Analytics over top contributors, change loyalty plan slug
2022-12-07 18:05:40 -05:00
Brandon Thomas
c1860a0584
add powerstream to reserved usernames
2022-12-07 16:39:40 -05:00
Brandon Thomas
70140c0e7d
new slurs I just found
2022-12-07 16:38:27 -05:00
Brandon Thomas
cc56deb27c
UserBadge moved to reusable_types
2022-12-06 06:39:10 -05:00
Brandon Thomas
a15324adee
CORS separation by environments + tests
2022-12-04 02:40:28 -05:00
Brandon Thomas
fa108a5303
Add more german languages, fix failing test time bomb
2022-12-03 23:25:08 -05:00
Brandon Thomas
7193ddf18b
Fix codegen, codegen db, and update docs for dev db setup
2022-12-03 22:30:57 -05:00
Brandon Thomas
21e74c5367
Fix build error with tts-download-job
2022-12-03 17:46:50 -05:00
Brandon Thomas
11304d77cb
Italian TTS
2022-12-03 17:42:46 -05:00
Brandon Thomas
ba52695f35
root directory option for downloader
2022-12-01 21:52:52 -05:00
Brandon Thomas
d28fb07d6d
Clean up new consolidated downloader so it can be deployed
2022-12-01 21:44:32 -05:00
Brandon Thomas
740b419989
codegen script for download job and inference job
2022-11-27 16:56:45 -05:00
Brandon Thomas
8f2640c5eb
relabel docker image
2022-11-27 16:21:22 -05:00
Brandon Thomas
6e7c708374
Duplicate tts-inference-job into inference-job
2022-11-27 16:07:29 -05:00
Brandon Thomas
7b0066bea5
Bugfix; download-job handles TTS model download (locally tested)
2022-11-27 05:17:02 -05:00
Brandon Thomas
3d3dec1e23
download job can now handle tacotron (untested)
2022-11-27 04:37:49 -05:00
Brandon Thomas
1ac61b7748
GPU support for docker commands
2022-11-27 03:28:30 -05:00
Brandon Thomas
24c9cc2d08
subprocess stuff in its own lib
2022-11-27 03:10:01 -05:00
Brandon Thomas
2392062276
Download script works with docker image
2022-11-27 02:45:17 -05:00
Brandon Thomas
94c74eb9e0
Refactor download job to be easier to generalize
2022-11-26 21:44:41 -05:00
Brandon Thomas
7f5ccac55c
rename generic-download-job -> download-job
2022-11-26 20:41:13 -05:00
Brandon Thomas
62c4f2cbe0
Merge branch 'master' of github.com:storytold/storyteller-rust
2022-11-19 02:56:38 -05:00
Brandon Thomas
507f97bef5
note on subscription statuses
2022-11-18 05:27:53 -05:00
Brandon Thomas
a628e986e5
analytics query
2022-11-18 05:14:48 -05:00
Brandon Thomas
2fdd3b38ea
codegen
2022-11-17 21:45:02 -05:00
Brandon Thomas
a3234b3cb4
Add max_decoder_steps / max_duration_seconds to tts job
2022-11-17 21:41:16 -05:00
Brandon Thomas
dbf3d541e2
Production plans
2022-11-16 06:05:59 -05:00
Brandon Thomas
f690c73ebf
Force environmental plans
2022-11-16 05:42:18 -05:00
Brandon Thomas
567f3143d4
fix test failure
2022-11-16 04:16:42 -05:00
Brandon Thomas
2416056f6f
list subscriptions endpoint
2022-11-16 03:10:07 -05:00
Brandon Thomas
e390a7d1ac
fix endpoint to accept json
2022-11-16 01:28:23 -05:00
Brandon Thomas
00ab91b05c
new development stripe plan, minor method name refactor
2022-11-15 23:31:30 -05:00
Brandon Thomas
b403ed7c9e
Customer portal JSON handler
2022-11-15 19:07:42 -05:00
Brandon Thomas
049b0cf375
rename directory
2022-11-14 21:36:07 -05:00
Brandon Thomas
0e6657e9b7
fix short sha tagging?
2022-11-14 11:13:10 -05:00
Brandon Thomas
acdea58a81
tag with short SHA
2022-11-14 11:12:19 -05:00
Brandon Thomas
9711a60494
test build caching of leaf dependency
2022-11-14 05:51:02 -05:00
Brandon Thomas
8edbb3efda
revert dockerfile
2022-11-14 04:51:25 -05:00
Brandon Thomas
87b319b99a
tagging image again (this might work)
2022-11-14 04:46:49 -05:00
Brandon Thomas
ed6f19c2ab
test image tagging
2022-11-14 04:39:01 -05:00
Brandon Thomas
31fc96c356
attempt to tag image
2022-11-14 04:35:26 -05:00
Brandon Thomas
4b6eab5a1d
fix image name?
2022-11-14 04:33:31 -05:00
Brandon Thomas
6af1234095
attempt to fix github action build (temporarily broke dockerfile)
2022-11-14 04:31:18 -05:00
Brandon Thomas
8132a0bcb0
Attempt to use build caching
2022-11-14 03:55:57 -05:00
Brandon Thomas
c679aa3430
Clean up dockerfile, add notes
2022-11-14 03:07:19 -05:00
Brandon Thomas
33485670dd
Remove Python models (see storyteller-ml repo), rework Dockerfile
...
- TTS and W2L were moved to storyteller-ml. TTS has been hosted there
for a while, but W2L will need to be reworked.
- Restructure Dockerfile to remove old Python deps.
- Also begin using "cargo-chef". Unsure if this will work to speed things up.
2022-11-14 00:39:41 -05:00
Brandon Thomas
9008e7c044
codegen
2022-11-13 23:09:31 -05:00
Brandon Thomas
2d2a0b68ff
fix errors from last yolo-commit
2022-11-13 17:37:12 -05:00
Brandon Thomas
a211d45f26
on-prem worker stats
2022-11-13 16:42:18 -05:00
Brandon Thomas
d20d8a4c1c
Not a slur
2022-11-13 16:14:30 -05:00
Brandon Thomas
9aec48d237
placeholder
2022-11-07 12:47:38 -05:00
Brandon Thomas
e4835258cb
deletion queries
2022-11-02 23:24:35 -04:00
Brandon Thomas
f34fd6fc4c
re-codegen tts job queries
2022-11-02 23:02:20 -04:00
Brandon Thomas
413d1b7c1c
Merge pull request #21 from storytold/tts-job-debugging
...
Log failure metadata for TTS inference jobs
2022-11-02 22:54:25 -04:00
Brandon Thomas
fb99af8a23
Log failure metadata for TTS inference jobs
2022-11-02 22:51:47 -04:00
Brandon Thomas
23b0dab44f
re-codegen sqlx
2022-11-02 16:41:03 -04:00
Brandon Thomas
8ee5eca076
Add debugging info to tts_inference_jobs table; move app routes
2022-11-02 16:28:45 -04:00
Brandon Thomas
9a1df0cd8c
Merge pull request #20 from storytold/premium-tts
...
Premium tts
2022-11-02 05:28:54 -04:00
Brandon Thomas
5377cca3b1
TTS now has premium features
2022-11-02 04:36:19 -04:00
Brandon Thomas
badcb4b058
Migrations to add duration controls to inference jobs
2022-11-02 00:36:36 -04:00
Brandon Thomas
28a4f5ca8d
Merge pull request #19 from storytold/subscription-schema-migrations-2
...
Migrations to change/rename some columns
2022-11-01 23:39:23 -04:00
Brandon Thomas
3efe1afa48
Migrations to change/rename some columns
2022-11-01 23:33:59 -04:00
Brandon Thomas
d4a7c06f72
Merge pull request #18 from storytold/premium-plans-sessions
...
Premium plans sessions
2022-11-01 06:56:19 -04:00
Brandon Thomas
6b4d0b3ad1
Adding premium info to sessions
2022-11-01 06:39:59 -04:00
Brandon Thomas
23f6e74fd8
ugh, a gross refactor commit
2022-11-01 03:19:08 -04:00
Brandon Thomas
778d7eba7e
Premium plans + session changes
2022-11-01 01:54:07 -04:00
Brandon Thomas
e5db702289
SSL local dev instructions
2022-10-31 01:46:31 -04:00
Brandon Thomas
4eb400867a
Merge pull request #17 from storytold/url-configs
...
Url configs
2022-10-31 01:32:38 -04:00
Brandon Thomas
4584e9dbcf
Cors and local nginx configs for dev.fakeyou.com etc.
2022-10-31 01:31:46 -04:00
Brandon Thomas
2ca477fd8c
Better environment-based URL configuration
2022-10-31 00:07:34 -04:00
Brandon Thomas
13487a9046
Fix bug with upsert not changing the product key
2022-10-30 05:25:22 -04:00
Brandon Thomas
aff94446ac
Merge pull request #16 from storytold/stripe-customer-portal
...
Stripe customer portal (subscription cancellation / modification)
2022-10-30 05:04:36 -04:00
Brandon Thomas
15c9c1256b
Stripe customer portal (subscription cancellation / modification)
2022-10-30 04:57:10 -04:00
Brandon Thomas
009d0eab87
CLI crates
...
(was building a stripe tool, but need to remember to make DB tools)
2022-10-29 22:20:26 -04:00
Brandon Thomas
0d9a882f3f
Refactor stripe component modules
2022-10-27 04:36:43 -04:00
Brandon Thomas
4c878e332e
upgrade breaking transitive dependency?
2022-10-25 05:13:24 -04:00
Brandon Thomas
d22242ab69
Merge pull request #15 from storytold/product-integration-2
...
Continued work on product integration
2022-10-25 05:03:19 -04:00
Brandon Thomas
5ee51ed8e2
Continued work on product integration
2022-10-25 05:02:52 -04:00
Brandon Thomas
560448f1ad
Merge pull request #14 from storytold/product-integration
...
Integrate stripe / product crate
2022-10-24 23:03:27 -04:00
Brandon Thomas
1b40495ef3
Integrate stripe / product crate
...
Associates internal metadata with stripe subscription and better
composes both systems
2022-10-24 23:02:16 -04:00
Brandon Thomas
e8d376a3eb
Merge pull request #13 from storytold/premium-plans
...
Premium plan definitions
2022-10-23 00:44:34 -04:00
Brandon Thomas
8e6c02d1b1
Premium plan definitions
2022-10-23 00:43:53 -04:00
Brandon Thomas
4e4dbf0688
Premium plans config (just getting started on this)
2022-10-21 19:18:37 -04:00
Brandon Thomas
1ca54927d7
fix compile errors
2022-10-21 03:19:28 -04:00
Brandon Thomas
ddd29ada80
This appears to fix openssl!? Transitive dep update.
2022-10-21 03:17:00 -04:00
Brandon Thomas
5ef27bb86f
Merge pull request #12 from storytold/tts-failure-slowdown
...
Slow down jobs on repeated failures
2022-10-21 00:46:34 -04:00
Brandon Thomas
c03bdba0a6
Slow down jobs on repeated failures
2022-10-21 00:46:00 -04:00
Brandon Thomas
14432e9808
Fix build errors (couldn't run build on Linux due to SSL breaks)
2022-10-09 06:06:56 -04:00
Brandon Thomas
1204ac5399
Merge pull request #11 from storytold/desktop-app-api-stubs
...
Stub API for the desktop app
2022-10-09 05:47:39 -04:00
Brandon Thomas
468d2d1d75
stupid time bomb
2022-10-09 05:46:49 -04:00
Brandon Thomas
aac2af635b
Stub API for the desktop app
2022-10-09 05:45:11 -04:00
Brandon Thomas
90c96b5f50
codegen from mac (broken on Ubuntu?)
2022-10-09 04:47:32 -04:00
Brandon Thomas
207e63a5aa
Merge pull request #10 from storytold/echelon-stripe
...
merge incomplete arc of work
2022-10-09 03:50:06 -04:00
Brandon Thomas
399ed6cb2e
fscking sqlx and ubuntu 22.04 ssl - wtf
...
I can't link against Ubuntu 22.04 native tls
I can't get rustls to work
wtf
2022-10-09 03:48:23 -04:00
Brandon Thomas
d51d6720e6
Setup on a more modern Ubuntu
2022-10-09 02:58:16 -04:00
Brandon Thomas
8f807a7719
wip
2022-09-22 05:36:16 -04:00
Brandon Thomas
c8ba2d1863
include price, make adjustments to subscription product/price
2022-09-19 06:30:49 -04:00
Brandon Thomas
2f3cbd4523
handle terminated subscriptions
2022-09-19 05:16:56 -04:00
Brandon Thomas
cf7cd9945d
Handle grace period days
2022-09-19 04:39:51 -04:00
Brandon Thomas
6a2a99741e
cancel_at_period_end and new test
2022-09-19 04:35:59 -04:00
Brandon Thomas
dc115a7aa1
begin handling deleted subscriptions
2022-09-19 04:18:08 -04:00
Brandon Thomas
6ea1bf3226
handle events with idempotency by ignoring replays
2022-09-19 04:11:35 -04:00
Brandon Thomas
334fc3022e
record whether webhook events had actions taken, idempotency flag
2022-09-19 03:54:32 -04:00
Brandon Thomas
3fb26771de
subscription interval tracked
2022-09-19 03:35:30 -04:00
Brandon Thomas
ba448ccc50
record subscription billing periods, start date
2022-09-19 02:09:35 -04:00
Brandon Thomas
fd3081e440
Track status as an enum, don't update at terminal state
2022-09-19 01:36:01 -04:00
Brandon Thomas
66981c4d2c
Track subscription status
2022-09-19 00:26:16 -04:00
Brandon Thomas
c6a1fc18d6
coalesce nulls
2022-09-19 00:12:21 -04:00
Brandon Thomas
afb77393c0
Don't update on create if already existing, make user token optional
2022-09-19 00:02:52 -04:00
Brandon Thomas
a2e71d8944
Handle subscription update and create
2022-09-18 23:26:39 -04:00
Brandon Thomas
ca63e00905
user subscriptions
2022-09-18 19:52:11 -04:00
Brandon Thomas
faf689dc09
log more info from webhooks
2022-09-17 13:33:22 -04:00
Brandon Thomas
aec31779b8
store webhook logs
2022-09-17 13:02:10 -04:00
Brandon Thomas
452a3473b3
WIP schema
2022-09-17 12:06:21 -04:00
Brandon Thomas
00322c6ed4
tests
2022-09-12 06:53:16 -04:00
Brandon Thomas
6dd02d48c4
extractor
2022-09-12 06:33:20 -04:00
Brandon Thomas
2eaf7c499e
subscription extractor
2022-09-11 22:18:43 -04:00
Brandon Thomas
3b82e7a389
tests
2022-09-11 21:37:40 -04:00
Brandon Thomas
c825f17672
wip
2022-09-11 03:40:18 -04:00
Brandon Thomas
6bbf4453da
notes
2022-09-10 20:11:49 -04:00
Brandon Thomas
dda247b5ea
Handle payment intent success
2022-09-10 18:57:13 -04:00
Brandon Thomas
f0435804ec
one-time payment
2022-09-10 18:24:45 -04:00
Brandon Thomas
176feda73b
wip
2022-09-10 17:41:45 -04:00
Brandon Thomas
f81d40b5bb
Make logging less verbose
2022-09-10 05:42:50 -04:00
Brandon Thomas
c07f100986
wip
2022-09-10 04:26:24 -04:00
Brandon Thomas
9feded54bd
most of the events we want
2022-09-10 04:26:24 -04:00
Brandon Thomas
4acec068aa
asdhfahsdf
2022-09-10 04:26:24 -04:00
Brandon Thomas
e1d4c0f5f3
ugh, I hate this part of the project
2022-09-10 04:26:24 -04:00
Brandon Thomas
f066658c3c
Move in-progress Stripe / billing work to shared component crate
2022-09-10 04:26:24 -04:00
Brandon Thomas
17021f04b9
fml payments
2022-09-10 04:26:24 -04:00
Brandon Thomas
0e5b4599bb
stripe wip
2022-09-10 04:26:24 -04:00
Brandon Thomas
02e7d1f4fa
Stripe WIP
2022-09-10 04:26:24 -04:00
Brandon Thomas
360a389e3d
Add stripe payments support
2022-09-10 04:26:22 -04:00
Brandon Thomas
999d73db81
analytics queries
2022-09-10 00:53:25 -04:00
Brandon Thomas
ec1f5edd5c
on-prem analytics queries
2022-09-09 14:40:41 -04:00
Brandon Thomas
2bc00dd6ca
comment describing why to include this in the dockerfile
2022-09-09 14:11:08 -04:00
Brandon Thomas
6e6253bf86
dockerfile fixes?
2022-09-09 04:41:48 -04:00
Brandon Thomas
97e6fdc51b
Downgrade docker rust build Ubuntu 22.04 -> 20.04 for openssl bug
2022-09-09 04:01:43 -04:00
Brandon Thomas
3cb9afa074
Update Dockerfile to point to new base Rust image
2022-09-09 02:26:38 -04:00
Brandon Thomas
34d08bce61
Not sure what recently broke with the dockerfile. Print Rust versions
2022-09-09 01:25:49 -04:00
Brandon Thomas
3b3603d7cf
How did I forget to include the lock file? ugh.
2022-09-09 01:09:44 -04:00
Brandon Thomas
ab0180a591
Update s3 bucket client to respect timeout arg
2022-09-09 00:45:44 -04:00
Brandon Thomas
40e92a1b24
Use no-op Redis status logger optionally
2022-09-08 15:22:52 -04:00
Brandon Thomas
bf9bc013df
New dynamic job progress reporter with no-op version
2022-09-08 14:56:35 -04:00
Brandon Thomas
4a58f49d3d
kill pending jobs
2022-09-04 21:34:50 -04:00
Brandon Thomas
da7270e058
Queries to investigate service load, etc.
2022-09-04 19:22:02 -04:00
Brandon Thomas
420a2c8b40
fix gravatar test
2022-09-01 23:49:17 -04:00
Brandon Thomas
d1e261e633
no longer fail tests (timebomb bump)
2022-09-01 23:43:31 -04:00
Brandon Thomas
bfe4b8d090
Merge pull request #9 from storytold/echelon-billing-and-images
...
Pull user system into a reusable component library
2022-09-01 23:40:32 -04:00
Brandon Thomas
269145a395
codegen db
2022-09-01 23:38:51 -04:00
Brandon Thomas
22122046ce
We're not ready to perform this migrations
...
I'm being lazy and not pulling the relevant commits out of history
2022-09-01 23:35:43 -04:00
Brandon Thomas
4284aeced6
Substantial refactor: pull user system (except mod controls) into crate
...
This has been tested in storyteller-web to ensure it still works
2022-09-01 23:33:21 -04:00
Brandon Thomas
d047fa50a9
Successfully move one "user" endpoint into new package
2022-09-01 17:25:13 -04:00
Brandon Thomas
273b5f3c4e
Move SessionCookieManager to users component
2022-08-29 05:39:00 -04:00
Brandon Thomas
3477cc395b
refactor
2022-08-29 04:49:51 -04:00
Brandon Thomas
59f2c4a55d
service stub for image-generation-service
2022-08-29 00:56:38 -04:00
Brandon Thomas
84c616b6f6
New lib and service crates
2022-08-29 00:28:26 -04:00
Brandon Thomas
57e3dd05c7
generated image data
2022-08-28 19:52:01 -04:00
Brandon Thomas
2b52488bfa
generated images tables
2022-08-25 04:01:50 -04:00
Brandon Thomas
3d2f28431f
add credits tables
2022-08-23 13:09:20 -04:00
Brandon Thomas
f1c8364b72
First attempt at generic_workloads table
2022-08-23 10:32:09 -04:00
Brandon Thomas
bb8ba60829
Initial schema migrations for generated images + billing
2022-08-23 10:07:15 -04:00
Brandon Thomas
50d6537a73
report worker node name, if available
2022-08-18 03:01:06 -04:00
Brandon Thomas
e68b6dc72d
Merge pull request #8 from storytold/echelon-list-tts-single-connector
...
Use single connector with list TTS endpoint
2022-08-17 19:42:33 -04:00
Brandon Thomas
1da020abd4
Use single connector with list TTS endpoint
2022-08-17 19:41:30 -04:00