salt
0cb11fbf7e
move route
2024-02-21 14:06:53 -08:00
salt
83b21f8965
fix errors
2024-02-21 13:29:09 -08:00
arensc
dc139a6199
renamed a function
2024-02-21 14:21:58 -05:00
arensc
c71a7de5be
Ok download code should work
2024-02-21 03:08:42 -05:00
arensc
559a9e1f4d
Ok builds now doing the actual download
2024-02-20 23:48:49 -05:00
arensc
ea8a911ba3
Need to save prompt now
2024-02-20 21:08:01 -05:00
arensc
ce28899e4c
Initial commit for storyteller web, going to work on inference job
2024-02-20 20:27:11 -05:00
saltacc
501eb24cd8
Merge pull request #303 from storytold/feature/comfy-replication
...
save job args to file modification info
2024-02-20 08:32:51 -08:00
salt
07d8125de9
remove excess message
2024-02-20 07:42:27 -08:00
salt
aa9e1c2fe4
new dependencies + download workflow from weight token
2024-02-20 07:41:05 -08:00
Kasisnu
3d64537e87
Merge pull request #305 from storytold/feb-19-mithoo
...
more labels on inference job metrics, thumbnails for face animator
2024-02-20 18:41:39 +05:30
Kasisnu
9c674b1579
send thumbnail task requests from face animator
2024-02-20 18:35:43 +05:30
Kasisnu
c6c94cfe56
slightly better instrumentation w/labels
2024-02-20 18:35:41 +05:30
Brandon Thomas
835bbe35c6
generate 4 images in a batch minimum
2024-02-20 03:37:51 -05:00
Brandon Thomas
029e29bf9a
last test cases for the night
2024-02-20 03:13:54 -05:00
Brandon Thomas
57956c8124
fix failing lints and tests
2024-02-20 02:44:43 -05:00
Brandon Thomas
ea269459e6
more prompt tests
2024-02-20 01:49:03 -05:00
Brandon Thomas
716589f62c
more safety + tests
2024-02-19 19:55:06 -05:00
Brandon Thomas
2d5188ba91
more dictionary terms and test cases
2024-02-19 19:37:03 -05:00
Brandon Thomas
d5205e764e
more prompt tests, better regex split
2024-02-19 18:54:13 -05:00
Brandon Thomas
3d8c01f8fe
remove sex from non-sex prompts
2024-02-19 17:49:04 -05:00
Brandon Thomas
f0a328c059
prompt engineering - replace bad prompts
2024-02-19 17:27:35 -05:00
Brandon Thomas
c87b1ba20d
filter more bad prompts
2024-02-19 12:55:01 -05:00
Kasisnu
d8f8735eca
Merge pull request #304 from storytold/feb-19-mithoo
...
add error handler for OTEL
2024-02-19 21:10:35 +05:30
Kasisnu
a2098b52d1
add error handler for OTEL
2024-02-19 21:09:54 +05:30
Kasisnu
b8ccb9f6e0
Merge pull request #302 from storytold/feb-16-mithoo
...
slightly tweakier instrumentation
2024-02-19 18:47:21 +05:30
Brandon Thomas
8dc3d29daf
Block basic absuive SD prompts
2024-02-19 02:31:07 -05:00
Brandon Thomas
42dfa3aa51
don't require user account for sd inference
2024-02-18 23:12:00 -05:00
Brandon Thomas
9ca42b370e
report sd queue stats
2024-02-18 03:46:48 -05:00
Brandon Thomas
ef9cc7de72
codegen db
2024-02-18 03:21:27 -05:00
Brandon Thomas
e7367bdfe7
return batch tokens in GET media file endpoint
2024-02-18 03:19:43 -05:00
Brandon Thomas
467d849121
list media files by batch token handler
2024-02-18 03:13:57 -05:00
Brandon Thomas
e98091c406
Insert batch token in media_file records
2024-02-18 02:40:15 -05:00
Brandon Thomas
c9c4fd59d9
stubs for engine persistence endpoints
2024-02-17 23:22:13 -05:00
salt
48b1f6306b
save job args to file modification info
2024-02-17 06:21:51 -08:00
Brandon Thomas
98c087116b
default to 3 images
2024-02-16 16:48:57 -05:00
Kasisnu
f13458a4e7
slightly tweakier instrumentation
2024-02-16 14:38:35 +05:30
Kasisnu
9903a31530
Merge pull request #299 from storytold/integrate-thumbnails-comfyui
...
Integrate thumbnails for comfyui outputs
2024-02-16 12:53:02 +05:30
Kasisnu
130326e7de
thumbnails builder for reuse
2024-02-16 12:51:54 +05:30
Brandon Thomas
d7295d79a1
ES search size: 30
2024-02-15 23:12:26 -05:00
Brandon Thomas
c00e0c59f3
fix cover image attachment
2024-02-15 22:45:20 -05:00
Brandon Thomas
3dc271bb84
accept cover image in API
2024-02-15 21:10:50 -05:00
Brandon Thomas
7bac45cad1
add migration for cover images in generic inference jobs (uploads)
2024-02-15 19:30:32 -05:00
Brandon Thomas
3cc0da13de
transcripts on list endpoints
2024-02-15 10:39:33 -05:00
Brandon Thomas
1aa7914eee
text transcripts on get media file
2024-02-15 10:29:08 -05:00
Brandon Thomas
d4bda54911
Merge pull request #301 from storytold/feb-14-mithoo
...
bvh result type is video; mime type/extension is set correctly
2024-02-14 19:12:18 -05:00
Brandon Thomas
30cef2bc57
validate compositor http request
2024-02-14 18:52:45 -05:00
Brandon Thomas
e462f0c08a
Store download URL in top-level job info
2024-02-14 18:24:58 -05:00
Brandon Thomas
04c0e09d6f
styletts include text transcript
2024-02-14 17:41:06 -05:00
Brandon Thomas
319a8f0ba8
add text transcripts to tts inference jobs
2024-02-14 17:34:04 -05:00
Brandon Thomas
4fa4a0a4e1
post-migration widening of file_size_bytes
2024-02-14 11:06:31 -05:00
Kasisnu
89099a4ef8
bvh result type is video; mime type/extension is set correctly
2024-02-14 15:57:32 +05:30
Brandon Thomas
53b2aedbb0
Five new schema migrations
2024-02-14 05:27:01 -05:00
Madhukar Mishra
5936ef87f4
fix - add gif to mimetype to ext
2024-02-14 12:15:35 +05:30
Brandon Thomas
00abb6230b
inference status - get model_weights title
2024-02-13 20:48:15 -05:00
Brandon Thomas
fa21d8251e
document job status endpoints
2024-02-13 20:31:59 -05:00
Brandon Thomas
17b38a62cf
add more staff accounts
2024-02-13 19:36:38 -05:00
Brandon Thomas
132230bbbe
enums got mixed up. we should rename these
2024-02-13 15:30:53 -05:00
Madhukar Mishra
be49dbd11e
fix extension for thumbnail output
2024-02-13 23:21:33 +05:30
Kasisnu
1b97d638a8
Merge pull request #300 from storytold/feb-13-mithoo
...
return errors from conversion endpoints when media file isnt sent
2024-02-13 21:57:13 +05:30
Kasisnu
bd653c70d8
return errors from conversion endpoints when media file isnt sent
2024-02-13 21:56:36 +05:30
Madhukar Mishra
dc31723f63
fixup
2024-02-13 18:50:32 +05:30
Madhukar Mishra
6b03981ef9
generate thumbnails in comfyui workflow
2024-02-13 18:50:32 +05:30
Brandon Thomas
d4a4ac4077
more users for the rollout
2024-02-12 12:34:51 -05:00
Brandon Thomas
32acf33eeb
after sd job, return the first media file token
2024-02-12 05:19:14 -05:00
Brandon Thomas
c9060d973f
feature flag more endpoints; don't return certain results in user list
2024-02-12 04:38:56 -05:00
Brandon Thomas
a64990230e
cleanup sd enqueue endpoint, remove flag check
2024-02-12 04:23:49 -05:00
Brandon Thomas
a3c6cc5b03
cache SD model weights in a cache directory
2024-02-11 07:19:41 -05:00
Brandon Thomas
f16ca22110
log downloads
2024-02-10 17:10:33 -05:00
Brandon Thomas
5fa8bb93ce
sensible default development configs (wip)
2024-02-10 16:53:08 -05:00
Brandon Thomas
91e8a51216
setup SD to use a predefined SD weight from our bucket
2024-02-10 16:47:21 -05:00
Brandon Thomas
7bd95d2078
split up sd job into three functions
2024-02-10 16:39:56 -05:00
Brandon Thomas
e0f141fa74
enable michael's account
2024-02-10 16:14:45 -05:00
Brandon Thomas
029798e665
codegen db - field widened?
2024-02-09 22:48:36 -05:00
Brandon Thomas
850e1b3c10
add UserDetailsLight + avatar to /v1/session endpoint + schema docs
2024-02-09 22:43:28 -05:00
Brandon Thomas
e1ea2cdf67
format api annotations
2024-02-09 22:02:43 -05:00
Brandon Thomas
74ed7f365b
UserDetailsLight refactor - consolidate, fix bug, get ready for reuse
2024-02-09 21:44:13 -05:00
Brandon Thomas
e327a8648c
simplify cli tool args
2024-02-09 01:04:15 -05:00
Kasisnu
88c68ccf9b
Merge pull request #293 from storytold/jan-31-mithoo
...
scaffold for bvh -> workflow job
2024-02-09 00:06:05 +05:30
Kasisnu
2e5fdd91d3
scaffold for bvh -> workflow job
2024-02-08 23:46:22 +05:30
Brandon Thomas
44135d8d10
enroll users in studio
2024-02-07 22:27:03 -05:00
Brandon Thomas
0d7afb10c2
codegen queries
2024-02-07 00:42:48 -05:00
Brandon Thomas
dd76a6fea1
flag to session endpoint
2024-02-06 23:41:26 -05:00
Brandon Thomas
1886f40a9b
handle flag check for dynamic user session types
2024-02-06 23:30:05 -05:00
Brandon Thomas
f54ddb0acb
feature flag off certain endpoints
2024-02-06 23:20:14 -05:00
Brandon Thomas
a7b5cc9fc3
add is_deleted flag to es
2024-02-06 23:20:14 -05:00
Brandon Thomas
0e24e38576
rollout column for studio access
2024-02-06 23:20:14 -05:00
Kasisnu
6bc6bf0c24
Merge pull request #271 from storytold/otel-instrumentation
...
Otel instrumentation - first pass
2024-02-06 09:58:59 +05:30
ArEnSc
fb2b5c9735
Merge pull request #297 from storytold/feature/downloader_fix
...
made extension and suffix changes.
2024-02-05 21:13:23 -05:00
ArEnSc
3d04302de1
Ok tested seems like the data is added correctly.
2024-02-05 21:09:05 -05:00
ArEnSc
7e169e3b51
Testing
2024-02-05 20:45:07 -05:00
ArEnSc
5ba8d876f0
made extension and suggix changes.
2024-02-05 18:51:09 -05:00
Kasisnu
44845ad54e
otel: some stats we were already logging to stdout
2024-02-05 20:59:40 +05:30
Madhukar Mishra
6ca7cbee31
remove job.inference_job_token as a label for a metric
2024-02-05 18:18:16 +05:30
Madhukar Mishra
2cf821d450
fix - add scheme and port to otel collector endpoint
2024-02-05 18:18:16 +05:30
Madhukar Mishra
d5ef9c0b78
use a sync instrument - histogram
2024-02-05 18:18:16 +05:30
Madhukar Mishra
6284b2a32f
update Cargo.lock
2024-02-05 18:18:16 +05:30
Madhukar Mishra
a104ae37aa
init metrics provider
2024-02-05 18:18:16 +05:30
Madhukar Mishra
fa3f506f27
fixup
2024-02-05 18:18:16 +05:30
Madhukar Mishra
eb4f06179e
fixup
2024-02-05 18:18:16 +05:30
Madhukar Mishra
6c86764798
fixup
2024-02-05 18:18:16 +05:30
Madhukar Mishra
cfa9558a33
add a metric to try otel
2024-02-05 18:18:14 +05:30
Madhukar Mishra
2cadfb105b
update .gitignore
2024-02-05 18:17:31 +05:30
Madhukar Mishra
97560cb1f7
add otel crate
2024-02-05 18:17:28 +05:30
Brandon Thomas
7450dd1525
whoops
2024-02-05 05:00:37 -05:00
Brandon Thomas
d8e066dc23
codegen db
2024-02-05 04:50:46 -05:00
Brandon Thomas
fdae854e3f
build es-update-job in docker
2024-02-05 04:48:51 -05:00
Brandon Thomas
541695f028
Merge pull request #296 from storytold/brandon-es-job
...
elasticsearch update job
2024-02-05 04:40:36 -05:00
Brandon Thomas
0719a929f8
pause on no updates
2024-02-05 04:37:04 -05:00
Brandon Thomas
c0c86c90b8
dev secrets
2024-02-05 04:11:49 -05:00
Brandon Thomas
a5c8f5fdc6
cleanup
2024-02-05 04:06:59 -05:00
Brandon Thomas
58210f0c25
job almost done
2024-02-05 04:00:37 -05:00
Brandon Thomas
ccf910e456
wip elasticsearch job
2024-02-04 21:57:27 -05:00
Brandon Thomas
d9197d2fd9
codegen db
2024-02-04 21:57:10 -05:00
Brandon Thomas
61d32a1790
more idempotency on more endpoints
2024-02-04 21:54:02 -05:00
Brandon Thomas
361b0e0894
generic idempotency token query; add to media file uploads
2024-02-04 21:45:21 -05:00
Brandon Thomas
12070bc399
indices on temporal columns in model_weights
2024-02-04 21:26:15 -05:00
Brandon Thomas
a49b8b4b74
logging
2024-02-04 02:58:03 -05:00
Brandon Thomas
2422f6d0aa
input.mp4 hardcoded
2024-02-04 02:21:52 -05:00
Brandon Thomas
a1fc56ecee
prompt argument for comfy
2024-02-04 01:48:05 -05:00
Brandon Thomas
05025d8817
maybe fix pathing
2024-02-04 01:04:43 -05:00
Brandon Thomas
bcea80c39b
get comfyui media downloads working
2024-02-04 00:43:46 -05:00
Brandon Thomas
cf59c8e2fc
extra logging
2024-02-03 23:49:51 -05:00
Brandon Thomas
5528993768
config for comfyui workflow
2024-02-03 23:44:21 -05:00
Brandon Thomas
da9e03e3ae
api for delete
2024-02-03 02:07:44 -05:00
Brandon Thomas
76b8b07d8a
6 sd batch size
2024-02-03 01:25:16 -05:00
Brandon Thomas
14cba8b8ed
fix sd inference pathing
2024-02-03 01:15:03 -05:00
Brandon Thomas
55805c2d75
safetensors -> pt x2
2024-02-03 00:42:16 -05:00
ArEnSc
ae80de8508
Merge pull request #295 from storytold/feature/comfyui
...
support docker container & more comfyui dependencies
2024-02-03 00:37:05 -05:00
Brandon Thomas
b965bfb602
file_size_bytes needs to be BIGINT
2024-02-03 00:20:08 -05:00
saltacc
f08cc3fd4a
support docker container & more requirements
2024-02-02 21:06:25 -08:00
Brandon Thomas
b7853b8914
debugging, safetensors -> pt
2024-02-02 23:57:39 -05:00
Brandon Thomas
26d5d6d272
sd: don't redirect stdout
2024-02-02 23:37:16 -05:00
Brandon Thomas
4e20f63f87
output stderr on failure
2024-02-02 23:28:43 -05:00
Brandon Thomas
c8fa722b3d
parameter for predefined SD weights
2024-02-02 23:17:12 -05:00
Brandon Thomas
0540d2caba
hack for VAE SD support
2024-02-02 22:58:28 -05:00
Brandon Thomas
449c29e824
process and upload glb instead of gltf+bin
2024-02-01 21:09:21 -05:00
Brandon Thomas
bf4bd8f21c
re-codegen
2024-02-01 20:37:53 -05:00
Brandon Thomas
59bcf8b040
also upload gltf binary companion file
2024-02-01 20:33:52 -05:00
Brandon Thomas
9785f3292d
Add GLB
2024-02-01 20:09:40 -05:00
Brandon Thomas
6f7262d0e8
Wrong index type for job_type. Hopefully nobody ran this.
2024-02-01 19:35:48 -05:00
Brandon Thomas
ec0b475457
other job types
2024-02-01 03:25:25 -05:00
Brandon Thomas
47db5d0f3d
InferenceJobType
2024-01-31 23:26:02 -05:00
Brandon Thomas
e9de700f2c
Migration to add job_type - we'll need to start populating this.
2024-01-31 23:10:16 -05:00
ArEnSc
f365f1a02f
Merge pull request #294 from storytold/feature/comfyui
...
Feature/comfyui
2024-01-31 21:49:33 -05:00
saltacc
bfebf60289
properly handle invalid jsonpaths
2024-01-31 17:38:56 -08:00
saltacc
f0f2788e1b
make things work with new stuff :/
2024-01-31 17:17:13 -08:00
saltacc
33b66f388f
Merge remote-tracking branch 'origin/master' into feature/comfyui
...
# Conflicts:
# crates/cli/dev-database-seed/src/seeding/model_weights.rs
2024-01-31 17:07:25 -08:00
Brandon Thomas
387cb22e65
more takedown requests
2024-01-31 02:37:07 -05:00
Brandon Thomas
7248425f30
takedown requests
2024-01-30 17:37:44 -05:00
saltacc
cc0e3a2f01
Merge remote-tracking branch 'origin/master' into feature/comfyui
2024-01-30 11:55:59 -08:00
saltacc
aa719ba56f
download requirements, fixes
2024-01-30 11:55:30 -08:00
Brandon Thomas
1da489a177
fix fbx2gltf script
2024-01-30 04:02:43 -05:00
Brandon Thomas
e777d996bc
document endpoint
2024-01-29 22:42:46 -05:00
Brandon Thomas
eeb6d486e1
enqueue fbx to gltf
2024-01-29 22:23:18 -05:00
Brandon Thomas
57ca10f23d
fix test/lint failures
2024-01-29 21:15:17 -05:00
Brandon Thomas
7b97c3bfd2
gltf upload hack
2024-01-28 07:17:11 -05:00
Brandon Thomas
111383a0ae
codegen db
2024-01-28 06:56:05 -05:00
Brandon Thomas
542a7c7116
upload fbx
2024-01-28 06:44:29 -05:00
Brandon Thomas
c6dc35eccb
cleanup; upload fbx
2024-01-28 06:30:22 -05:00
Brandon Thomas
d8fbc09867
fbx2gltf should work - just needs endpoint
2024-01-28 05:29:57 -05:00
Brandon Thomas
2b0ebd5350
env vars for development fbx2gltf
2024-01-28 03:39:45 -05:00
Brandon Thomas
8d22697855
better environment variable errors
2024-01-28 03:36:17 -05:00
Brandon Thomas
6cdbe9ea00
configuration for fbx2gltf
2024-01-28 02:21:44 -05:00
Brandon Thomas
15db937039
tests on command runner
2024-01-28 01:35:24 -05:00
Brandon Thomas
a01bde2a4b
env var policy
2024-01-28 01:08:01 -05:00
Brandon Thomas
98bf91fa17
Merge pull request #292 from storytold/bt-fbx-to-gltf
...
fbx to gltf (wip)
2024-01-27 23:54:41 -05:00
Brandon Thomas
6f4fe5c542
create command_adapter WIP
2024-01-27 23:54:09 -05:00
Brandon Thomas
ebae1dbc9f
fbx to gltf
2024-01-27 20:51:36 -05:00
ArEnSc
39a07b25f5
Merge pull request #291 from storytold/feature/sd_finalstand
...
Fixed GDrive download check.
2024-01-27 01:38:02 -05:00
ArEnSc
168afd72cd
Fixed GDrive download check.
2024-01-27 01:29:57 -05:00
Brandon Thomas
8ba103fd2b
fix test
2024-01-27 00:07:01 -05:00
Brandon Thomas
ef53d96a27
fix tests
2024-01-26 23:58:51 -05:00
Brandon Thomas
ebc6834128
fix test lints
2024-01-26 23:51:46 -05:00
ArEnSc
ea1090b8ef
Merge pull request #290 from storytold/feature/sd_finalstand
...
Feature/sd finalstand
2024-01-26 04:32:40 -05:00
ArEnSc
3415ad4e80
loRA's work
2024-01-26 04:01:37 -05:00
Brandon Thomas
9c9c2b4fff
codegen db, fix compile error
2024-01-25 23:01:53 -05:00
Brandon Thomas
7bea2ed724
Inference job stub for format conversion (fbx2gltf)
2024-01-25 22:48:34 -05:00
Brandon Thomas
e7f2aed1ef
new inference category for fbx -> gltf
2024-01-25 20:26:46 -05:00
Brandon Thomas
13573437fb
de-duplication of query logic
2024-01-25 20:17:49 -05:00
Brandon Thomas
215e958405
improve inference-job selection predicates
2024-01-25 20:12:19 -05:00
ArEnSc
1238f95af8
Merge branch 'master' into feature/sd_finalstand
2024-01-25 16:31:25 -05:00
ArEnSc
69e6a73ef4
Fixing issues and testing.
2024-01-25 13:46:30 -05:00
ArEnSc
51ce0c29cb
It should work kasisnu will help
2024-01-25 05:59:14 -05:00
ArEnSc
e45ee58cdf
Uploads should work testing required...
2024-01-25 05:12:11 -05:00
Brandon Thomas
d80b883ce7
a few more clippylints
2024-01-24 23:16:36 -05:00
Brandon Thomas
0743684f0d
cookie samesite policy for netlify branch deploys
2024-01-23 22:37:04 -05:00
Brandon Thomas
2a2b08d711
moderators don't want to see deleted files
2024-01-23 21:57:20 -05:00
ArEnSc
06feb58d83
commiting env as well to fix problem with the local dev env
2024-01-23 16:05:40 -05:00
ArEnSc
e91f57944e
fixed bugs in sql mapping and loRA pathing.
2024-01-23 16:05:20 -05:00
saltacc
84a2aa6108
use input file, fix ext and prefix
2024-01-23 12:58:09 -08:00
Brandon Thomas
126ed66232
enqueue tts - work with model_weights
2024-01-23 14:19:48 -05:00
Brandon Thomas
af8fb02078
comments
2024-01-23 12:50:06 -05:00
ArEnSc
968af24ccc
builds again adding the metadata.
2024-01-22 21:41:51 -05:00
Brandon Thomas
2c8e9ff823
fix lint issues
2024-01-22 21:01:06 -05:00
Brandon Thomas
403529c83d
codegen db
2024-01-22 20:55:05 -05:00
Brandon Thomas
ea85dbc6e6
rename types to be better self-documenting
2024-01-22 20:54:19 -05:00
Brandon Thomas
0ee62b64fe
Merge pull request #289 from storytold/brandon-migrate-tts-inference
...
migrate TTS inference to weights
2024-01-22 20:45:25 -05:00
Brandon Thomas
d2d295c12f
migrate TTS inference to weights
2024-01-22 20:44:38 -05:00
ArEnSc
edb2a7f95a
It builds again.
2024-01-22 19:18:27 -05:00
saltacc
aff8d5d310
Merge remote-tracking branch 'origin/master' into feature/comfyui
...
# Conflicts:
# crates/lib/api_clients/cloud_storage/src/remote_file_manager/media_descriptor.rs
# crates/lib/api_clients/cloud_storage/src/remote_file_manager/remote_cloud_bucket_details.rs
2024-01-22 13:31:40 -08:00
ArEnSc
f37c04ee07
Merge pull request #287 from storytold/feature/media-seed-tool
...
make seed tool for media uploads
2024-01-22 15:07:45 -05:00
saltacc
93f8a95298
make seed tool for media uploads
2024-01-22 12:01:45 -08:00
saltacc
55367e8723
Resolved merge conflict by keeping my changes in process_job.rs
2024-01-22 10:37:19 -08:00
ArEnSc
957b68f679
Fixed insert generic.
2024-01-21 23:47:50 -05:00
Brandon Thomas
cb6feaaa46
disable tts edit/delete when migrated
2024-01-21 03:21:00 -05:00
Brandon Thomas
c7bc5e3686
fix import errors; codegen db
2024-01-21 01:16:09 -05:00
Brandon Thomas
0811e12c0b
port legacy GET TTS endpoint to model weights
2024-01-21 01:10:20 -05:00
Brandon Thomas
65c5138533
document index
2024-01-20 21:30:51 -05:00
Brandon Thomas
20ced958e6
Merge pull request #286 from storytold/brandon-port-tts-queries
...
port TTS enqueue to weights
2024-01-20 19:58:30 -05:00
Brandon Thomas
22026977d9
port TTS enqueue to weights
2024-01-20 19:56:26 -05:00
Brandon Thomas
f812fbb4e6
rust lint: unused mut
2024-01-20 18:40:15 -05:00
ArEnSc
20832a9af9
Almost there need to test that one endpoint
2024-01-20 09:15:25 -05:00
Brandon Thomas
7558a4edc9
fix lint and test failures
2024-01-19 21:00:21 -05:00
ArEnSc
59745551ce
Merge pull request #285 from storytold/feature/comfyui
...
ComfyUI Support
2024-01-19 16:27:46 -05:00
saltacc
3e875fb6fa
uncomment
2024-01-19 13:08:58 -08:00
saltacc
da2ea13524
Merge remote-tracking branch 'origin/master' into feature/comfyui
2024-01-19 12:41:56 -08:00
saltacc
550a11c493
make it work 🔥
2024-01-19 12:40:19 -08:00
Brandon Thomas
a4b549af19
allow larger file uploads
2024-01-19 02:56:46 -05:00
ArEnSc
7eb93c7600
Builds on inference for batch creation of entries.
2024-01-19 00:17:53 -05:00
Brandon Thomas
c44cc5671f
ES cleanup, additional param
2024-01-18 22:53:17 -05:00
Brandon Thomas
380933d1aa
much cleaner queries
2024-01-18 22:36:04 -05:00
ArEnSc
5298c028e0
Fix small bug.
2024-01-18 20:50:16 -05:00
ArEnSc
ad32bdb119
Fixing routing for inference jobs to support uploads properly.
2024-01-18 20:26:19 -05:00
Brandon Thomas
3318067cb5
hide deleted files from mods/admins - it's just clutter
2024-01-18 19:24:39 -05:00
Brandon Thomas
c15360ddb3
ElasticSearch test
2024-01-18 18:17:21 -05:00
saltacc
e741951630
update
2024-01-18 09:22:30 -08:00
Brandon Thomas
c91f548878
hack elasticsearch options
2024-01-18 01:58:36 -05:00
Brandon Thomas
35231e5f82
fix last test failures
2024-01-17 23:13:47 -05:00
saltacc
7f1173956a
comfyui
2024-01-17 17:39:31 -08:00
Brandon Thomas
f6da4f3247
fix lints
2024-01-17 20:34:13 -05:00
Brandon Thomas
8dc7c81a78
fix tests
2024-01-17 19:48:03 -05:00
ArEnSc
387dbbeed9
Merge pull request #266 from storytold/feature/image_generation
...
Feature/image generation
2024-01-17 19:27:23 -05:00
ArEnSc
cecd3dd6df
Update .env
2024-01-17 18:03:20 -05:00
ArEnSc
7b90b11ce6
Fixed build issues ready to merge to master after review.
2024-01-17 17:33:55 -05:00
ArEnSc
fc154c4a31
Merge branch 'master' into feature/image_generation
2024-01-17 15:22:53 -05:00
ArEnSc
24818f8ecf
Ok this builds inference job. Fixes still needed
2024-01-17 03:06:09 -05:00
Brandon Thomas
2d91504eb5
test to show usage
2024-01-17 02:21:23 -05:00
Brandon Thomas
67a8bb739b
Merge pull request #279 from storytold/brandon-insert-batch-generations
...
insert batch generation records
2024-01-16 23:01:10 -05:00
Brandon Thomas
33613cb5d8
insert batch generation records
2024-01-16 23:00:17 -05:00
Brandon Thomas
2487a8d646
refactor query modules
2024-01-16 21:03:56 -05:00
Brandon Thomas
1771e1dffe
fix lint/test failures
2024-01-16 20:52:11 -05:00
Brandon Thomas
2d4d2c667f
reference schemas
2024-01-16 19:49:08 -05:00
Brandon Thomas
0c99852dfd
Merge pull request #278 from storytold/brandon-new-tables
...
new tables: idempotency_tokens, batch_generations; new column
2024-01-16 19:11:36 -05:00
Brandon Thomas
7cc310764e
new tables: idempotency_tokens, batch_generations; new column
2024-01-16 19:10:23 -05:00
Kasisnu
b66b04d86c
Merge pull request #277 from storytold/jan-16-mithoo
...
bugfix: ignore more than one samples for zs
2024-01-16 13:06:48 +05:30
Kasisnu
18d46a0f57
bugfix: ignore more than one samples for zs
2024-01-16 13:06:29 +05:30
Kasisnu
97795fac22
Merge pull request #276 from storytold/jan-16-mithoo
...
codegen & styletts2 downloader cleanup
2024-01-16 11:40:30 +05:30
Kasisnu
cec0cfc907
remove misleading downloaders from styletts2
2024-01-16 11:39:46 +05:30
Kasisnu
d516058802
codegen
2024-01-16 11:36:28 +05:30
Kasisnu
b77810cd29
Merge pull request #268 from storytold/jan-04-mithoo
...
adds styletts2 as voice designer model
2024-01-16 10:52:06 +05:30
Brandon Thomas
2507cf0332
analysis of AI streamer bug reports
2024-01-15 21:48:45 -05:00
Brandon Thomas
cf4c335d41
migration tool for tts models
2024-01-15 21:27:44 -05:00
Kasisnu
5e98049c50
switch from vallex -> styletts2 for zero shot
2024-01-15 17:44:29 +05:30
ArEnSc
eebedbce07
Runs inference but the checkpoint is corrupt?
2024-01-14 18:39:33 -05:00
Brandon Thomas
89cd104551
codegen
2024-01-13 22:58:39 -05:00
Brandon Thomas
5933387f5c
tts_models migration: weights db column, list tts models
2024-01-13 22:49:14 -05:00
Brandon Thomas
b5009d5985
bvh extension
2024-01-13 03:42:06 -05:00
Brandon Thomas
de4548795c
handle BVH file uploads
2024-01-13 03:38:17 -05:00
ArEnSc
f4497a4aee
Fixed build errors inference job should be good to run now.
2024-01-13 02:27:12 -05:00
Brandon Thomas
6122f11cf3
Add MediaFileOriginDetails to list media files for user
2024-01-13 01:40:34 -05:00
Brandon Thomas
929105bb85
add color index to cover images
2024-01-13 01:22:31 -05:00
Brandon Thomas
a76272aeb3
doc
2024-01-13 01:13:21 -05:00
Brandon Thomas
4c9cb5d986
add MediaFileOriginDetails to list featured media files
2024-01-13 01:12:04 -05:00
Brandon Thomas
108806cb52
list media files - MediaFileOriginDetails + title
2024-01-13 01:00:55 -05:00
ArEnSc
447a457dff
image gen should build.
2024-01-13 00:26:51 -05:00
Brandon Thomas
ce852eda8a
netlify feature branch cors
2024-01-12 15:51:50 -05:00
Kasisnu
ea3a6d3c0b
pass appropriate arguments to styletts inference command
2024-01-12 17:58:12 +05:30
Kasisnu
c6a6676f08
adds styletts2 as voice designer model
2024-01-12 14:53:55 +05:30
ArEnSc
7f65014d6d
Almost done inference.
2024-01-12 02:33:36 -05:00
ArEnSc
c4681937b3
Image generation on it's way...
2024-01-12 00:19:09 -05:00
Brandon Thomas
5949d1d4e7
fix names of search fields
2024-01-12 00:18:44 -05:00
Brandon Thomas
c01ffe33a5
cover image details on all informational weight endpoints
2024-01-11 23:32:52 -05:00
Brandon Thomas
f251e8b88a
document types
2024-01-11 21:39:29 -05:00
Brandon Thomas
65ea06767a
cover image details on list weights
2024-01-11 21:28:32 -05:00
ArEnSc
2d52ac0fa9
Removed some components,
...
also added the command env variables, now going to run inference.
2024-01-11 21:24:38 -05:00
Brandon Thomas
5643ecae89
CoverImageDetails
2024-01-11 21:16:10 -05:00
Brandon Thomas
c1b152cc35
default cover images (part 1)
2024-01-11 20:56:37 -05:00
Brandon Thomas
65bdea264d
move mod user_avatars
2024-01-11 20:34:13 -05:00
Brandon Thomas
0bca56a9db
query bug - referenced old columns
2024-01-11 20:19:34 -05:00
Brandon Thomas
990f51bef0
fix failing tests and lints
2024-01-11 19:38:27 -05:00
Brandon Thomas
c8be79c1dc
change enum serialization
2024-01-11 19:15:55 -05:00
Brandon Thomas
dca8ff7014
deprecated lint; clarify serde casing
2024-01-11 19:09:38 -05:00
ArEnSc
8709fa9c8a
enqueue is there. testing inference side.
2024-01-11 16:43:04 -05:00
Brandon Thomas
d11c236257
analyze download jobs
2024-01-11 16:25:38 -05:00
Brandon Thomas
3a0246822f
change token name for frontend
2024-01-11 15:57:17 -05:00
Brandon Thomas
690afa66d7
ugh, it was feature flagged
2024-01-11 05:48:03 -05:00
Brandon Thomas
0657880a9b
this was 404ing, not sure why (too tired)
2024-01-11 05:21:16 -05:00
Brandon Thomas
792c109bb6
query exact indices in elasticsearch
2024-01-11 04:57:08 -05:00
Brandon Thomas
95987860f4
codegen
2024-01-11 02:30:17 -05:00
Brandon Thomas
6104782041
api docs for elasticsearch
2024-01-11 02:29:40 -05:00
Brandon Thomas
b75dea434f
model_weights elasticsearch endpoint
2024-01-11 02:23:42 -05:00
Brandon Thomas
3372447a0b
cli elasticsearch search
2024-01-11 02:03:57 -05:00
Brandon Thomas
33323baf22
elasticsearch schema
2024-01-10 23:33:10 -05:00
Brandon Thomas
6e681b0ff6
Merge pull request #275 from storytold/brandon-es-wip
...
elasticsearch wip
2024-01-10 22:54:19 -05:00
Brandon Thomas
aa1a007c5e
elasticsearch wip
2024-01-10 22:53:36 -05:00
ArEnSc
4250469fd3
enqueue_image_generation
...
fixes added checks and changes to the interface.
Will document the api as well.
2024-01-10 20:35:53 -05:00
Brandon Thomas
590ef4701e
codegen
2024-01-10 04:24:06 -05:00
Brandon Thomas
38d14ad361
stats on list weights (explore)
2024-01-10 04:22:33 -05:00
Brandon Thomas
8b63c7e5bc
stats for get weight handler
2024-01-10 04:04:17 -05:00
Brandon Thomas
ae80d5c02d
clear out bookmark token if soft deleted (recommended by victor)
2024-01-10 03:38:47 -05:00
Brandon Thomas
d3de1c9a4b
add stats to list weights by user (remove old fields)
2024-01-10 03:32:56 -05:00
Brandon Thomas
70691437f3
add stats to featured weights handler
2024-01-10 03:05:22 -05:00
Brandon Thomas
e63f4e08bf
stats on list media for user handler
2024-01-10 02:39:52 -05:00
Brandon Thomas
0fae1229b6
stats on get media file endpoint
2024-01-10 02:34:43 -05:00
Brandon Thomas
aae75c4050
fix batch bookmark bug
2024-01-10 02:21:37 -05:00
ArEnSc
19670459e8
Merge pull request #273 from storytold/feature/mocap-net
...
Add mocapnet
2024-01-10 00:34:18 -05:00
saltacc
240bf5f488
size arg & todo comment
2024-01-09 21:11:14 -08:00
Brandon Thomas
b8c26fa9ce
remove fields
2024-01-09 23:18:37 -05:00
Brandon Thomas
52d7e0585e
Merge pull request #274 from storytold/brandon-more-stats-2
...
add stats on all endpoints
2024-01-09 23:12:22 -05:00
Brandon Thomas
9f54bfe0ab
add stats on all endpoints
2024-01-09 23:11:24 -05:00
saltacc
7714f0c056
add command line arguments
2024-01-09 19:26:46 -08:00
saltacc
dbdc5b3c9d
fix directories, mime, and inference categories
2024-01-09 18:58:01 -08:00
saltacc
c25cc3b126
add mocapnet
2024-01-09 16:21:32 -08:00
Brandon Thomas
c07e71b8c3
add bookmark tokwn to batch get bookmarks
2024-01-09 00:35:29 -05:00
Brandon Thomas
0aaacdddaa
reusable type
2024-01-08 23:30:16 -05:00
Brandon Thomas
52af33a94d
stats on list bookmarks for user endpoint
2024-01-08 23:25:49 -05:00
Brandon Thomas
7900d732c7
codegen queries
2024-01-08 00:31:34 -05:00
Brandon Thomas
af24c8d469
Merge pull request #270 from storytold/brandon-ratings-counts
...
collect rating stats
2024-01-08 00:30:41 -05:00
Brandon Thomas
de768158ab
collect rating stats
2024-01-08 00:29:52 -05:00
Brandon Thomas
1237aa8a10
rename create -> upsert
2024-01-07 23:14:47 -05:00
Brandon Thomas
f601c4a385
codegen DB, comment
2024-01-06 09:57:30 -05:00
Brandon Thomas
d03c53ed2e
fix logic on delete, too
2024-01-05 23:59:06 -05:00
Brandon Thomas
cd0c35de4a
fix increment logic
2024-01-05 23:54:13 -05:00
Brandon Thomas
39a5440b81
Merge pull request #269 from storytold/brandon-record-stats
...
record stats
2024-01-05 23:37:16 -05:00
Brandon Thomas
12f59916b6
record stats
2024-01-05 23:34:12 -05:00
ArEnSc
e5ed4d986f
downloading works.
2024-01-05 17:20:21 -05:00
ArEnSc
ea84b009a8
Fix compile issues
2024-01-05 16:01:42 -05:00
ArEnSc
aa202172a2
uploading models and then reseed.
2024-01-04 21:46:25 -05:00
ArEnSc
1b4e3cccb5
Fixed over sight in the cloud file remote_file_manager,
...
where the metadata didn't include the bucket path for the file.
Then we didn't pass the correct upload path with the file name
2024-01-04 17:28:00 -05:00
ArEnSc
796e8b5aee
Compile fix switching to rust rover since less mapping is required now.
2024-01-04 09:57:45 -05:00
Brandon Thomas
4489ffb95e
Merge pull request #267 from storytold/brandon-stats-table
...
remove stats from model_weights, add a stats side table
2024-01-04 01:59:35 -05:00
Brandon Thomas
733fb9bf53
Drop stats info from model weights (we'll do a JOIN soon)
2024-01-04 01:49:53 -05:00
Brandon Thomas
79cbeaffe0
stats table
2024-01-04 01:10:32 -05:00
ArEnSc
1614cba2f8
properties added
2024-01-03 23:16:00 -05:00
ArEnSc
dbe989c5a1
rebuilds on the routes in storyteller web.
2024-01-03 22:32:25 -05:00
ArEnSc
a2cad0b289
getting the args for inference working.
2024-01-03 14:57:49 -05:00
ArEnSc
74db1683b1
unwraped the args
2024-01-03 11:01:37 -05:00
Brandon Thomas
6aef6fa99e
Merge pull request #265 from storytold/brandon-batch-get-user-bookmarks
...
batch get user bookmarks
2024-01-03 05:04:08 -05:00
Brandon Thomas
205ac37c3d
batch get user bookmarks
2024-01-03 05:03:27 -05:00
Brandon Thomas
cd02103457
prevent abuse of endpoint
2024-01-03 04:33:12 -05:00
Brandon Thomas
46f184483f
Merge pull request #264 from storytold/brandon-batch-get-user-ratings
...
batch get user ratings
2024-01-03 04:07:44 -05:00
Brandon Thomas
ecd1a12438
batch get user ratings
2024-01-03 04:06:54 -05:00
Brandon Thomas
ad7b69030b
Merge pull request #263 from storytold/brandon-report-rating-count-on-rating
...
report rating count on rating
2024-01-03 01:21:16 -05:00
Brandon Thomas
cd583e3b91
report rating count on rating
2024-01-03 01:07:47 -05:00
Brandon Thomas
291b4a2ff9
Merge pull request #262 from storytold/brandon-bookmark-count-on-add
...
return bookmark count after adding or removing a bookmark
2024-01-03 00:00:19 -05:00
Brandon Thomas
c4017370bf
return bookmark count after adding or removing a bookmark
2024-01-02 23:09:46 -05:00
ArEnSc
6e5e326d0e
Ok it builds time to fillout the inference command.
2024-01-02 23:06:12 -05:00
ArEnSc
bcd806e7f0
Some boilerplate done.
2024-01-02 17:50:22 -05:00
ArEnSc
20b95c090e
Now testing the end point.
2024-01-02 16:16:51 -05:00
ArEnSc
87b2f4a113
Args are tested
2024-01-02 12:55:34 -05:00
ArEnSc
a7799be70e
Merge branch 'master' into feature/image_generation
2024-01-02 12:36:18 -05:00
ArEnSc
7d858d2c19
Payload almost ready need to migrate the db and write unit tests.
2024-01-02 12:24:13 -05:00
ArEnSc
733c24aebb
Working on enqueuing image generation
2024-01-02 10:50:24 -05:00
Brandon Thomas
d120489daf
featured media files model metadata
2024-01-01 23:24:15 -05:00
Brandon Thomas
0c1f4ff0e3
Merge pull request #261 from storytold/brandon-strong-types-list-available-weights
...
strong types on list available weights
2024-01-01 23:14:33 -05:00
Brandon Thomas
32df84a8ce
strong types on list available weights
2024-01-01 23:14:00 -05:00
Brandon Thomas
2ea38f0ff4
rename response fields to be in line with others
2023-12-31 00:41:57 -05:00
Brandon Thomas
993d60a746
Merge pull request #260 from storytold/brandon-list-weight-by-user-query-scoping
...
scope queries on list weight by user
2023-12-30 23:58:26 -05:00
Brandon Thomas
e4ae6c0af2
scope queries on list weight by user
2023-12-30 23:57:58 -05:00
Brandon Thomas
88610b2c58
unused variables lint
2023-12-30 23:19:44 -05:00
Brandon Thomas
9d94737737
fix lint, add new lint (unused parens)
2023-12-30 20:29:25 -05:00
Brandon Thomas
4cf4c3c5a2
Merge pull request #259 from storytold/brandon-bookmarks-creators
...
add creator details to user bookmarks (for weights, media files)
2023-12-30 02:32:51 -05:00
Brandon Thomas
3c1cba1fad
add creator details to user bookmarks (for weights, media files)
2023-12-30 02:31:33 -05:00
Brandon Thomas
1bf58b01e1
Merge pull request #257 from storytold/brandon-rename-weights-fields
...
rename singular "weights_*" fields to "weight_*"
2023-12-29 12:07:33 -05:00
Brandon Thomas
66594ce8f5
rename singular "weights_*" fields to "weight_*"
2023-12-29 12:07:10 -05:00
Brandon Thomas
03bed40e57
fix broken query
2023-12-29 00:45:06 -05:00
Brandon Thomas
ab7afcfb72
Merge pull request #256 from storytold/brandon-get-weight-creator-and-cover
...
get weight - add creator + cover for model weights; rename fields
2023-12-28 23:09:46 -05:00
Brandon Thomas
b331cc999c
get weight - add creator + cover for model weights; rename fields
2023-12-28 23:08:54 -05:00
Brandon Thomas
dbd91dd67f
Merge pull request #255 from storytold/brandon-update-weight-cover-image
...
update weight cover image in update endpoint
2023-12-28 22:26:10 -05:00
Brandon Thomas
b0ed202c6a
update weight cover image in update endpoint
2023-12-28 22:25:14 -05:00
Brandon Thomas
556454ce9c
Merge pull request #254 from storytold/brandon-bookmark-media-file-info
...
media file info (path, type) on bookmarks
2023-12-28 21:08:44 -05:00
Brandon Thomas
5d49f5c4e4
media file info (path, type) on bookmarks
2023-12-28 21:08:16 -05:00
Brandon Thomas
23daee1272
codegen db
2023-12-28 20:12:28 -05:00
Brandon Thomas
3deeaf8803
Merge pull request #253 from storytold/brandon-add-cover-to-bookmarks
...
add cover to bookmark model weights
2023-12-28 20:11:12 -05:00
Brandon Thomas
f0879a5241
add cover to bookmark model weights
2023-12-28 20:10:39 -05:00
Brandon Thomas
5be341f5fc
Merge pull request #252 from storytold/brandon-fix-weight-auth
...
fix get weight auth
2023-12-28 19:39:55 -05:00
Brandon Thomas
186622cedd
fix get weight auth
2023-12-28 19:39:26 -05:00
Brandon Thomas
1db9fd7a2a
Merge pull request #251 from storytold/brandon-get-media-file-model-info
...
model info on get media file
2023-12-28 19:23:15 -05:00
Brandon Thomas
e5f21f26c8
model info on get media file
2023-12-28 19:22:21 -05:00
Brandon Thomas
a37dc7d498
update docs
2023-12-28 18:32:40 -05:00
Brandon Thomas
b9b5051a99
Merge pull request #250 from storytold/brandon-add-bookmark-model-data
...
add model data to bookmark results
2023-12-28 16:36:07 -05:00
Brandon Thomas
e0f0a3dd92
add model data to bookmark results
2023-12-28 16:33:14 -05:00
Brandon Thomas
adee3d577d
Merge pull request #249 from storytold/brandon-add-bookmark-query-filters
...
bookmark query filters
2023-12-28 16:11:51 -05:00
Brandon Thomas
97335b2233
bookmark query filters
2023-12-28 16:10:33 -05:00
Brandon Thomas
779b171208
download job analytics
2023-12-28 15:40:01 -05:00
Brandon Thomas
17e5641a00
Merge pull request #248 from storytold/dec-27-mithoo
...
weights & media files list endpoints respect visibility
2023-12-27 18:13:49 -05:00
Kasisnu
afa91c032e
fix typos in ratings endpoints docs
2023-12-27 16:43:07 +05:30
Kasisnu
a76807ab7d
document user rating endpoint
2023-12-27 16:32:09 +05:30
Kasisnu
15c1cb8e5e
list weights/endpoints return public/private results based on user session
2023-12-27 16:04:10 +05:30
Kasisnu
4a69589f1d
Merge pull request #247 from storytold/dec-26-mithoo
...
minor query builder updates for editing weights and paginatinating weights explore
2023-12-27 11:55:16 +05:30
Kasisnu
ed72cf7f7f
rename per_page -> page_size for consistency
2023-12-27 11:54:30 +05:30
Kasisnu
ad093d3fa8
explore weights query builder offset
2023-12-26 20:02:39 +05:30
Kasisnu
b505896864
update weights w/query builder
2023-12-26 16:16:47 +05:30
Brandon Thomas
b680002c6b
fix download job
2023-12-24 03:22:50 -05:00
Brandon Thomas
40bb91f024
fix lints
2023-12-24 02:42:58 -05:00
Brandon Thomas
fa002d3fe3
Merge pull request #245 from storytold/brandon-make-model-weights-descriptions-optional
...
make model_weights descriptions optional
2023-12-24 02:25:12 -05:00
Brandon Thomas
02bec3655c
make model_weights descriptions optional
...
- these will be bad to have on low-value weights, eg. zero shot.
- want to capture this change now
2023-12-24 02:24:20 -05:00
Brandon Thomas
12b7f4d25e
fix broken download job query
2023-12-24 01:40:20 -05:00
Brandon Thomas
02d6f6c940
fix a class of model download failures
2023-12-24 01:24:58 -05:00
Brandon Thomas
f5d7c93c22
media file scoping query bug fix
2023-12-23 23:46:03 -05:00
ArEnSc
0125eba7cc
Merge pull request #244 from storytold/feature/missing-response-values
...
Fixed added weights type by request.
2023-12-23 23:26:49 -05:00
Michael Chung
30127e19e9
Fixed added weights type by request.
2023-12-23 23:25:43 -05:00
ArEnSc
033e42d1b1
Merge pull request #243 from storytold/feature/missing-response-values
...
Add missing data in response
2023-12-23 15:02:13 -05:00
Michael Chung
c50a2b36aa
Add missing data in response
...
get weight endpoint to have updated_at (the list weight has but the single weight doesnt)
profile weight list endpoint weights_category is missing from the response, i need it for rendering the cards by what type of weight it is.
2023-12-23 14:46:45 -05:00
Brandon Thomas
aa0632bd41
Merge pull request #242 from storytold/dec-21-mithoo
...
media files pagination fix
2023-12-22 14:11:41 -05:00
Brandon Thomas
87cc49982e
model weights es document
2023-12-22 12:57:50 -05:00
Brandon Thomas
853943f21a
mimetype reuse
2023-12-22 11:01:21 -05:00
Kasisnu
6f9dd4d6e3
make user bookmarks pagination consistent with media/weights
2023-12-22 18:15:29 +05:30
Kasisnu
5de56cd11b
make public weights & media list behave similarly wrt pagination
2023-12-22 13:14:31 +05:30
Kasisnu
df16a4aa89
media files pagination fix
2023-12-22 13:06:30 +05:30
Brandon Thomas
613289f1ab
update docs
2023-12-21 23:41:37 -05:00
Brandon Thomas
ae49b9da7d
fix image uploads
2023-12-21 23:16:15 -05:00
Brandon Thomas
3f531ae9f0
API doc, fix field name
2023-12-21 23:08:13 -05:00
Brandon Thomas
370bcf3f2d
Merge pull request #241 from storytold/brandon-rename-avatar-to-cover
...
rename avatar to cover_image
2023-12-21 22:54:15 -05:00
Brandon Thomas
685264e20c
fix seeding; codegen
2023-12-21 22:53:28 -05:00
Brandon Thomas
2c7400bf76
update code references (avatar -> cover_image)
2023-12-21 22:49:44 -05:00
Brandon Thomas
fae36d485b
migrations to simplify media files on a model
2023-12-21 22:26:41 -05:00
Brandon Thomas
fe3107b1b0
fix lints/tests failures
2023-12-21 22:11:00 -05:00
Brandon Thomas
bdde5da223
Merge pull request #240 from storytold/brandon-more-avatar-images
...
more "avatar" images on weights
2023-12-21 21:06:27 -05:00
Brandon Thomas
7539237ee4
more "avatar" images on weights
2023-12-21 21:05:14 -05:00
ArEnSc
49796c69e3
Merge pull request #239 from storytold/feature/weights_files
...
Feature/weights files
2023-12-21 20:51:39 -05:00
ArEnSc
08f59a1989
Update .env
2023-12-21 19:53:07 -05:00
Michael Chung
15c218286f
Bucket Orchestration work complete.
2023-12-21 19:51:32 -05:00
Brandon Thomas
268346f662
delete more easily
2023-12-21 19:40:33 -05:00
Brandon Thomas
7897ef730e
refactor, fix tests
2023-12-21 19:04:56 -05:00
Brandon Thomas
43da5c91ad
fix compile error
2023-12-21 18:47:28 -05:00
Brandon Thomas
71360879f3
cleanup
2023-12-21 18:43:18 -05:00
ArEnSc
7f80e106bd
Merge pull request #238 from storytold/dec-21-mithoo
...
use public pagination for profile weights list endpoint
2023-12-21 14:30:17 -05:00
Kasisnu
58181b32cf
use public pagination for profile weights list endpoint
2023-12-22 00:45:24 +05:30
Michael Chung
0efe2d8177
Working Tests
2023-12-21 12:38:04 -05:00
ArEnSc
62c5d86584
Merge pull request #237 from storytold/dec-21-mithoo
...
Document user bookmarks endpoints
2023-12-21 12:34:48 -05:00
Brooks Palin
cbb950cb40
Update general_setup.md
...
Fixed path for for storyteller-web
2023-12-21 10:30:36 -07:00
Kasisnu
64be9e49af
Document user bookmarks endpoints
2023-12-21 19:52:44 +05:30
Brandon Thomas
bd688703df
Merge pull request #236 from storytold/brandon-creator-details
...
add creator details
2023-12-21 04:29:36 -05:00
Brandon Thomas
c627c13e2d
add creator details
2023-12-21 04:28:55 -05:00
Brandon Thomas
84104d91ac
Merge pull request #235 from storytold/brandon-model-weight-avatars
...
model weight avatars
2023-12-21 04:13:58 -05:00
Brandon Thomas
64806135c5
model weight avatars
2023-12-21 04:13:44 -05:00
Brandon Thomas
5e48a6193a
reorganize modules
2023-12-21 02:57:00 -05:00
Brandon Thomas
11c17f0a1d
fix lints
2023-12-21 02:37:29 -05:00
Michael Chung
ed97cdbb0d
Ok builds again going to run unit tests.
2023-12-21 02:25:20 -05:00
Brandon Thomas
cd91a25c3d
Merge pull request #219 from storytold/dec-18-mithoo
...
document media files list endpoints, fix public page offset bug
2023-12-21 02:11:19 -05:00
Kasisnu
c52d197717
sort user media file results by creation date
2023-12-21 12:35:44 +05:30
kasisnu
79d64c51ad
fix bug with page offsets for public pagination
2023-12-21 12:35:44 +05:30
kasisnu
3e8d7be00e
add remaining media files endpoints to openapispec
2023-12-21 12:35:42 +05:30
kasisnu
3a5b765e51
send favorite/comment counts with media file list endpoint
2023-12-21 12:33:04 +05:30
Brandon Thomas
6df4804e2a
Merge pull request #228 from storytold/dec-19-mithoo
...
fail voice conversion jobs after model deleted
2023-12-21 02:02:17 -05:00
Michael Chung
6b2d4ffdce
Adding the mocks
2023-12-21 01:58:43 -05:00
Brandon Thomas
e6ac364622
Merge pull request #234 from storytold/brandon-rename-model-weights-bucket-fields
...
rename model_weights bucket fields: private -> public
2023-12-21 01:31:28 -05:00
Brandon Thomas
0cff684e97
rename model_weights bucket fields: private -> public
2023-12-21 01:30:10 -05:00
Michael Chung
86c80fdf19
Things build again editor works well.
2023-12-21 01:01:35 -05:00
Michael Chung
eca8b01f14
Missed 1 file.
2023-12-21 00:42:22 -05:00
Michael Chung
1bddb21e9f
Missed 1 file.
2023-12-21 00:41:26 -05:00
Michael Chung
20b950794c
Ok it builds need to test it using a mock.
2023-12-21 00:40:17 -05:00
Brandon Thomas
d698168f9e
Merge pull request #233 from storytold/brandon-upload-media-file
...
media file upload
2023-12-21 00:40:02 -05:00
Brandon Thomas
dd41c268e4
media file upload
2023-12-21 00:38:04 -05:00
Brandon Thomas
d5280964bc
Merge pull request #232 from storytold/brandon-fix-download-job-and-api
...
Fix download-job; fix Victor's API issue
2023-12-20 21:38:48 -05:00
Brandon Thomas
c715d6795c
Fix download-job; fix Victor's API issue
2023-12-20 21:37:48 -05:00
Brandon Thomas
4159191d68
Merge pull request #231 from storytold/brandon-tts-migration
...
work on tts model migration
2023-12-20 18:18:14 -05:00
Brandon Thomas
5e04cc6c2f
work on tts model migration
2023-12-20 18:15:05 -05:00
Michael Chung
0d58176f0f
Minor bug fixes then testing.
2023-12-20 02:23:45 -05:00
Michael Chung
57f383612f
Now testing time!
2023-12-20 02:20:44 -05:00
Michael Chung
ab3a312898
Ok so it actually compiles right now.
2023-12-20 00:13:02 -05:00
Michael Chung
a2aa71e8a6
builds properly now working on the download aspect.
2023-12-19 23:25:18 -05:00
Brandon Thomas
c49ec5af2f
Merge pull request #230 from storytold/brandon-run-rvc-svc-migration
...
migration cleanup
2023-12-19 23:23:20 -05:00
Brandon Thomas
44d75baeec
update old record with token
2023-12-19 22:26:04 -05:00
Brandon Thomas
922e76eeb1
migration fix wip
2023-12-19 21:53:04 -05:00
Brandon Thomas
3b2f386cdb
Merge pull request #229 from storytold/brandon-paths-fix
...
fix/cleanup some paths, fix tests
2023-12-19 20:44:35 -05:00
Brandon Thomas
61f30618b0
fix/cleanup some paths, fix tests
2023-12-19 20:43:27 -05:00
Michael Chung
3e02d791af
Merge branch 'master' into feature/weights_files
2023-12-19 17:44:39 -05:00
Michael Chung
70694ce330
Need to replace the hashing function with a new one and merge master.
2023-12-19 17:43:24 -05:00
Kasisnu
c116ad90d0
fail voice conversion jobs after model deleted
2023-12-19 16:45:38 +05:30
Brandon Thomas
5093621995
Merge pull request #227 from storytold/brandon-migration-fixes
...
migration fixes (tested locally)
2023-12-19 05:53:43 -05:00
Brandon Thomas
44056ee956
revert testing changes, re-codegen
2023-12-19 05:51:59 -05:00
Brandon Thomas
70e4af2b4c
fix rvc index
2023-12-19 05:36:29 -05:00
Brandon Thomas
fd28585e13
download to new public buckets for weights
2023-12-19 05:30:15 -05:00
Brandon Thomas
0e8aefce5c
download job should also save sha
2023-12-19 04:53:49 -05:00
Brandon Thomas
0549e8eb6a
migrate shasum
2023-12-19 04:48:02 -05:00
Brandon Thomas
0c35dc5068
fix inference job bucket client choice
2023-12-19 04:15:34 -05:00
Brandon Thomas
987d983051
download / upload models
2023-12-19 03:53:42 -05:00
Brandon Thomas
0144c969bc
DO NOT MERGE - migration fixes
...
Don't land the LEFT OUTER JOIN to users !!!!!!
!!!!!
!!!!
2023-12-19 03:10:26 -05:00
Michael Chung
775d867add
Ok fixed compilation issues.
2023-12-19 03:05:39 -05:00
Michael Chung
da62443522
Fixed some issues using a box
2023-12-19 02:48:41 -05:00
Michael Chung
1ae2df8fa7
working on the file manager for uploads and downloads
2023-12-19 02:40:42 -05:00
Brandon Thomas
e63eef03cd
missed a few migration queries
2023-12-19 02:33:27 -05:00
Brandon Thomas
36c76365bc
Merge pull request #226 from storytold/brandon-migration-tool
...
voice_conversion_models ➤➤➤➤➤ model_weights
2023-12-19 01:50:00 -05:00
Brandon Thomas
1432c19d3b
fix all failing lints
2023-12-19 01:47:36 -05:00
Brandon Thomas
4edea1d68f
codegen db + fix compile error
2023-12-19 01:40:40 -05:00
Brandon Thomas
2b186720c1
analytic query
2023-12-19 01:37:21 -05:00
Brandon Thomas
d2faacc796
This might be it! model list is ported
2023-12-19 01:37:21 -05:00
Brandon Thomas
b2555bc756
populate "new token"
2023-12-19 01:37:21 -05:00
Brandon Thomas
169b45413d
port internal model cache
2023-12-19 01:37:21 -05:00
Brandon Thomas
b0df97b2be
reuse migration code (+ migration crate)
2023-12-19 01:37:21 -05:00
Brandon Thomas
d03fb5ed0f
migration support + tests
2023-12-19 01:37:21 -05:00
Brandon Thomas
0420605535
inference query for weights (vc)
2023-12-19 01:37:21 -05:00
Brandon Thomas
5454171112
move module
2023-12-19 01:37:21 -05:00
Brandon Thomas
d518d54471
download job query
2023-12-19 01:37:21 -05:00
Brandon Thomas
b17b1f565c
working
2023-12-19 01:37:21 -05:00
Brandon Thomas
bacb3ce5b1
migration code wip
2023-12-19 01:37:21 -05:00
Brandon Thomas
b124028055
Migration tool for voice conversion models
2023-12-19 01:37:21 -05:00
Michael Chung
2e6d7d96e4
Merge branch 'master' into feature/weights_files
2023-12-18 21:18:01 -05:00
ArEnSc
382fd8680d
Merge pull request #225 from storytold/feature/weights_seed_fix
...
Seed Model weights fix
2023-12-18 21:13:34 -05:00
Michael Chung
87a7bd6ac4
Seed Model weights fix
2023-12-18 21:08:43 -05:00
ArEnSc
d68979024e
Merge pull request #224 from storytold/feature/rerender
...
Feature/rerender
2023-12-18 19:06:35 -05:00
saltacc
25b90c07ce
add model downloading
2023-12-18 15:49:55 -08:00
Michael Chung
39bae02259
Merge branch 'feature/weights_files' of https://github.com/storytold/storyteller-rust into feature/weights_files
2023-12-18 09:26:42 -05:00
Michael Chung
7755a5683b
Working on file descriptors though gotta learn some rust things, quickly for boiler plate.
2023-12-18 09:26:12 -05:00
Brandon Thomas
0578980205
re-home nessu's models (per vegito)
2023-12-16 23:26:16 -05:00
Brandon Thomas
732dd27d0f
fix build errors; kebab-case all CLI apps
2023-12-15 19:39:06 -05:00
Brandon Thomas
c137e1ace3
migration tool binary bootstrap
2023-12-15 19:28:37 -05:00
ArEnSc
f31e93b109
Merge pull request #218 from storytold/feature/weights_files
...
Feature/weights files
2023-12-15 18:36:31 -05:00
ArEnSc
6aeb325d10
Merge branch 'master' into feature/weights_files
2023-12-15 18:36:23 -05:00
Michael Chung
2c6a07659a
Ok weights now are properly linked.
2023-12-15 16:59:13 -05:00
Michael Chung
0e1f6187bf
Weights path working on the generic version.
2023-12-15 16:29:36 -05:00
Brandon Thomas
a6806d3616
indices on model_weights and users (there weren't any on model_weights!)
2023-12-15 13:57:22 -05:00
Brandon Thomas
98fa0a67ea
rename extension tables
2023-12-15 13:33:14 -05:00
Brandon Thomas
11e3a4e429
rename model_weights_samples -> model_weights_preview_samples
...
- doing this before anyone else runs these migrations
- also added "squashed" documentation on the model_weights and
associated tables
- also added (commented) good indices for model_weights
2023-12-15 12:47:33 -05:00
Brandon Thomas
d9e45c0291
Merge pull request #217 from storytold/brandon-lots-of-schema-changes-afoot
...
Lots of schema changes afoot - model_weights migration, covers, samples
2023-12-15 10:27:58 -05:00
Brandon Thomas
5108f94c0f
Lots of schema changes afoot - model_weights migration, covers, samples
...
Model weights migration (old tokens):
- model_weights.maybe_migration_old_model_token
Model weights migration (new tokens):
- tts_models.maybe_migration_new_model_weights_token
- vocoder_models.maybe_migration_new_model_weights_token
- voice_conversion_models.maybe_migration_new_model_weights_token
Cover and banner images for models:
- model_weights.maybe_banner_media_file_token
- model_weights.maybe_cover_media_file_token
Avatar and banner images for users:
- users.maybe_avatar_media_file_token
- users.maybe_cover_media_file_token
Sample multimedia for models:
- model_weights_samples (new table)
2023-12-15 10:26:08 -05:00
Brandon Thomas
6fc1dd263c
migration dir had a space in it
2023-12-14 20:23:03 -05:00
Brandon Thomas
186979ecbd
fix lints and other issues
2023-12-14 18:40:44 -05:00
Brandon Thomas
6c9b0a5c2a
fix bad github merge
2023-12-14 18:30:54 -05:00
Brandon Thomas
92b5a4c90b
Merge pull request #215 from storytold/brandon-fix-clap-upgrade
...
Fix clap in various CLI tools post 2.x -> 4.x upgrade
2023-12-14 18:23:46 -05:00
Brandon Thomas
e9cd505e0b
Fix clap in various CLI tools post 2.x -> 4.x upgrade
2023-12-14 18:22:05 -05:00
Brandon Thomas
561493182e
Merge pull request #164 from storytold/dependabot/cargo/clap-4.4.8
...
Bump clap from 2.34.0 to 4.4.8
2023-12-14 17:52:26 -05:00
Brandon Thomas
5f673095eb
Merge pull request #173 from storytold/dependabot/cargo/old_code/pubsub-enricher/openssl-0.10.60
...
Bump openssl from 0.10.33 to 0.10.60 in /old_code/pubsub-enricher
2023-12-14 17:36:43 -05:00
Brandon Thomas
bf3c199592
Merge pull request #172 from storytold/dependabot/cargo/old_code/twitch-ingestion-client/openssl-0.10.60
...
Bump openssl from 0.10.32 to 0.10.60 in /old_code/twitch-ingestion-client
2023-12-14 17:36:19 -05:00
Brandon Thomas
9cf629c324
Merge pull request #174 from storytold/dependabot/cargo/old_code/twitter-ingestion-client/openssl-0.10.60
...
Bump openssl from 0.10.34 to 0.10.60 in /old_code/twitter-ingestion-client
2023-12-14 17:36:11 -05:00
Brandon Thomas
4a6009cf78
Merge pull request #175 from storytold/dependabot/cargo/old_code/twitch-tts-desktop-client/openssl-0.10.60
...
Bump openssl from 0.10.36 to 0.10.60 in /old_code/twitch-tts-desktop-client
2023-12-14 17:36:01 -05:00
Brandon Thomas
8789c53a0a
Merge pull request #183 from storytold/dependabot/cargo/async-stripe-0.26.0
...
Bump async-stripe from 0.25.2 to 0.26.0
2023-12-14 17:27:07 -05:00
Brandon Thomas
46f5689cbb
Merge pull request #213 from storytold/dec-14-mithoo
...
make media endpoint for profiles follow public pagination
2023-12-14 17:26:13 -05:00
Brandon Thomas
97ee848e64
Merge pull request #178 from storytold/nov-29-mithoo
...
update media file visibilty handler
2023-12-14 17:23:53 -05:00
Brandon Thomas
2f67bd41cf
Merge branch 'master' into nov-29-mithoo
2023-12-14 17:23:45 -05:00
Brandon Thomas
4b2cfaeb09
Merge pull request #211 from storytold/brandon-deterministic-test-tokens
...
deterministic test tokens
2023-12-14 17:03:22 -05:00
Brandon Thomas
b05cde1de1
Merge pull request #214 from storytold/brandon-fix-logout
...
fix logout
2023-12-14 17:01:55 -05:00
Brandon Thomas
60d4199216
fix logout
...
The reason this is so labyrinthine is because of the users and billing
components. They bind dynamic behaviors that are defined in
storyteller-web (one of them being clearing the redis session cache).
Actually, the users component _didn't_, because it was defined in the
billing component. So I hoisted it out into a new component library.
In the fullness of time I imagine all of this will be consolidated back
under storyteller-web so we don't have to worry about binding actions at
a distance.
Anyway, this is tested and works locally.
2023-12-14 16:58:37 -05:00
Brandon Thomas
a88d888c18
featured media weights endpoint
2023-12-14 16:35:07 -05:00
Brandon Thomas
5a4d2a8c06
media files query by tokens (WHERE IN clause)
2023-12-14 15:15:31 -05:00
Brandon Thomas
32b1786b59
No hateful / antisemitic models on our service (hitler)
2023-12-14 14:53:17 -05:00
Brandon Thomas
8618e774e7
codegen db
2023-12-14 13:37:25 -05:00
kasisnu
ff7ea2a4db
make media endpoint for profiles follow public pagination
2023-12-14 16:27:21 +05:30
Brandon Thomas
b85415c03a
Merge pull request #212 from storytold/brandon-polymorphic-token-checks
...
polymorphic token checks (thanks kasisnu!) + new token types
2023-12-14 04:40:53 -05:00
Brandon Thomas
eee75f0711
polymorphic token checks (thanks kasisnu!) + new token types
2023-12-14 04:37:44 -05:00
Brandon Thomas
d447ad7d86
deterministic test tokens
...
it'd be good to use the same token values in tests, dev seed tools, etc.
this should be a threadsafe, resettable, deterministic RNG
2023-12-14 03:49:58 -05:00
Brandon Thomas
faff80fcc6
deterministic RNGs for tests
2023-12-14 03:20:47 -05:00
Brandon Thomas
f9a913b944
Merge pull request #210 from storytold/brandon-featured-weights
...
Featured weights endpoint
2023-12-14 02:35:15 -05:00
Brandon Thomas
a0375f10e2
Featured weights endpoint
2023-12-14 02:34:04 -05:00
saltacc
2f971dda60
add model downloading
2023-12-13 21:17:44 -08:00
dependabot[bot]
cf034a900e
Bump clap from 2.34.0 to 4.4.8
...
Bumps [clap](https://github.com/clap-rs/clap ) from 2.34.0 to 4.4.8.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v2.34.0...v4.4.8 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-14 04:27:36 +00:00
ArEnSc
1ea5acdd51
Merge pull request #209 from storytold/feature/weights_seed_v2
...
Seeding model weights
2023-12-13 23:22:19 -05:00
ArEnSc
aad6b4e304
Update .env
2023-12-13 23:21:55 -05:00
Michael Chung
a25e9aba91
Seeding model weights
2023-12-13 23:18:14 -05:00
saltacc
7c96d3b75b
Merge pull request #205 from storytold/feature/rerender
...
rerender a video
2023-12-13 17:34:52 -08:00
Brandon Thomas
0ed04839d3
takedown request
2023-12-13 20:27:04 -05:00
saltacc
b30c352d79
pass tests
2023-12-13 16:29:45 -08:00
saltacc
cb2d36401c
merge rerender a video
2023-12-13 16:12:30 -08:00
Brandon Thomas
7dea4c64fa
Merge pull request #208 from storytold/brandon-more-rate-limiter-fixes
...
more rate limiter fixes
2023-12-13 17:04:14 -05:00
Brandon Thomas
9ab8e52211
more rate limiter fixes
2023-12-13 16:58:37 -05:00
Brandon Thomas
81dd377599
clean up and test rate limiter choice code
2023-12-13 15:27:34 -05:00
Brandon Thomas
e641f26d21
Merge pull request #207 from storytold/brandon-ai-streamer-support
...
Rate limiter support for AI streamers
2023-12-13 13:35:51 -05:00
Brandon Thomas
3766758cfb
Rate limiter support for AI streamers
2023-12-13 13:33:48 -05:00
Brandon Thomas
196be25fb5
voice takedown requests
2023-12-13 11:04:13 -05:00
salt
57e2f70707
WORKING!
2023-12-12 23:07:27 -08:00
salt
292b831d16
update tests
2023-12-12 17:36:53 -08:00
salt
d51ee67d4c
complete failure
2023-12-12 17:35:36 -08:00
Brandon Thomas
e375c8090c
fix IDE handling (code compiled and tested, but IDE unhappy)
2023-12-12 19:21:42 -05:00
Brandon Thomas
e5a85c7528
fix failing doctest
2023-12-12 18:56:02 -05:00
salt
14432cce83
fix errors
2023-12-12 15:12:34 -08:00
salt
43030402ca
update
2023-12-12 14:50:50 -08:00
salt
2d59c5c573
initial commit
2023-12-12 13:47:12 -08:00
dependabot[bot]
8bb82c0fe5
Bump async-stripe from 0.25.2 to 0.26.0
...
Bumps [async-stripe](https://github.com/arlyon/async-stripe ) from 0.25.2 to 0.26.0.
- [Release notes](https://github.com/arlyon/async-stripe/releases )
- [Changelog](https://github.com/arlyon/async-stripe/blob/master/CHANGELOG.md )
- [Commits](https://github.com/arlyon/async-stripe/compare/v0.25.2...v0.26.0 )
---
updated-dependencies:
- dependency-name: async-stripe
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-12 16:59:57 +00:00
Brandon Thomas
18309385b4
Merge pull request #204 from storytold/brandon-nix-newrelic
...
Kill newrelic. This is painful to keep upgrading
2023-12-12 11:58:33 -05:00
Brandon Thomas
f9ff9b8c9f
Kill newrelic. This is painful to keep upgrading
...
Keeping the vendor directory because we may introduce later. We've
already done some upkeep.
2023-12-12 11:57:42 -05:00
Brandon Thomas
d22d64fac7
Merge pull request #195 from storytold/fix_warnings
...
Fix some warnings
2023-12-12 03:44:46 -05:00
Brandon Thomas
08d8e5279e
Merge pull request #201 from storytold/dependabot/cargo/version-sync-0.9.5
...
Bump version-sync from 0.8.1 to 0.9.5
2023-12-12 03:43:43 -05:00
dependabot[bot]
d9fe4e56a0
Bump version-sync from 0.8.1 to 0.9.5
...
Bumps [version-sync](https://github.com/mgeisler/version-sync ) from 0.8.1 to 0.9.5.
- [Release notes](https://github.com/mgeisler/version-sync/releases )
- [Commits](https://github.com/mgeisler/version-sync/compare/0.8.1...0.9.5 )
---
updated-dependencies:
- dependency-name: version-sync
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-12 08:00:32 +00:00
Brandon Thomas
dcf6451693
Merge pull request #199 from storytold/dependabot/cargo/hyper-tls-0.6.0
...
Bump hyper-tls from 0.5.0 to 0.6.0
2023-12-12 02:57:31 -05:00
Brandon Thomas
dbe3d5e977
Merge pull request #200 from storytold/dependabot/cargo/tokio-1.34.0
...
Bump tokio from 0.1.22 to 1.34.0
2023-12-12 02:56:41 -05:00
Brandon Thomas
07750fa122
refactor bucket modules
2023-12-12 02:55:23 -05:00
Brandon Thomas
795eb7a141
spacing nit
2023-12-12 02:15:06 -05:00
Brandon Thomas
d49b01930e
Merge pull request #198 from storytold/dec-07-mithoo-bookmarks
...
Rename favorites -> user_bookmarks, add new table
2023-12-11 23:36:22 -05:00
Brandon Thomas
052e4bfbd8
Merge pull request #203 from storytold/brandon-seed-media-files-2
...
seed video files + fix idempotency
2023-12-11 22:11:00 -05:00
Brandon Thomas
30d6bca9b2
seed video files + fix idempotency
2023-12-11 21:53:31 -05:00
Brandon Thomas
94d62736ad
Merge pull request #202 from storytold/brandon-seed-media-files
...
Seed media files
2023-12-11 21:07:08 -05:00
Brandon Thomas
1cde23c080
Seed media files
2023-12-11 20:52:20 -05:00
dependabot[bot]
d3be9a3a6b
Bump tokio from 0.1.22 to 1.34.0
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 0.1.22 to 1.34.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-0.1.22...tokio-1.34.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-11 22:09:11 +00:00
dependabot[bot]
c09adc3729
Bump hyper-tls from 0.5.0 to 0.6.0
...
Bumps [hyper-tls](https://github.com/hyperium/hyper-tls ) from 0.5.0 to 0.6.0.
- [Commits](https://github.com/hyperium/hyper-tls/compare/v0.5.0...v0.6.0 )
---
updated-dependencies:
- dependency-name: hyper-tls
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-11 22:08:50 +00:00
Michael Chung
e78cdf85e3
Upload weights front end side done,
...
need to write the download code then run inference depending on the model.
2023-12-11 14:40:14 -05:00
kasisnu
5971d95a80
Rename favorites -> user_bookmarks, add new table
2023-12-11 21:08:33 +05:30
Brandon Thomas
602de6d736
env vars
2023-12-08 05:15:13 -05:00
Brandon Thomas
de8eb05db6
inference-job - sadtalker to work with image media files
2023-12-08 04:45:28 -05:00
Brandon Thomas
996f8ce05b
inference-job : sad talker to use audio media files
2023-12-08 04:38:46 -05:00
Brandon Thomas
b4afec5c26
rename endpoint (internally)
2023-12-08 04:21:16 -05:00
Brandon Thomas
ab1f81036f
update my-workspace-hack
2023-12-08 04:00:42 -05:00
Brandon Thomas
4a806e7d67
codegen db
2023-12-08 02:16:50 -05:00
Brandon Thomas
c811296bdc
temporarily disable test
2023-12-08 02:04:34 -05:00
Brandon Thomas
6033289a36
fix most tests and lints
2023-12-08 01:36:39 -05:00
Brandon Thomas
90ec14b8d0
vendored needs to refer to workplace-hack
2023-12-08 01:27:10 -05:00
Brandon Thomas
e18b86a55a
everything needs to refer to workplace-hack
2023-12-08 01:25:49 -05:00
salt
d39962491f
fix some warnings (mostly unnecessary mut)
2023-12-07 18:36:51 -08:00
ArEnSc
6c320dd329
Merge pull request #180 from storytold/feature/weights_endpoints
...
Feature/weights endpoints WIP
2023-12-07 20:15:55 -05:00
Michael Chung
fd95aaff8c
Merge branch 'feature/weights_endpoints' of https://github.com/storytold/storyteller-rust into feature/weights_endpoints
2023-12-07 20:02:02 -05:00
Michael Chung
8afd10c864
minor fixes to spelling
2023-12-07 17:52:21 -05:00
ArEnSc
0e62fe9d08
Merge branch 'master' into feature/weights_endpoints
2023-12-07 00:35:53 -05:00
Michael Chung
dda2e0840d
Updated docs and weights_types
2023-12-07 00:25:57 -05:00
Michael Chung
b26276cfda
done now for code
2023-12-06 23:36:20 -05:00
Brandon Thomas
eedbc346fe
Merge pull request #194 from storytold/brandon-tts-as-media-file
...
Save TTS results as media files
2023-12-06 23:33:51 -05:00
Brandon Thomas
7976f68fd0
Save TTS results as media files
2023-12-06 23:31:47 -05:00
Michael Chung
f327dfcdbb
Builds and docs work
2023-12-06 23:27:34 -05:00
Michael Chung
f4176bf84a
Alright should fix the generation now...
2023-12-06 21:31:37 -05:00
Michael Chung
43b6808f23
Ok fixed docs and avaoilable weights endpoint
2023-12-06 20:05:23 -05:00
Michael Chung
330f24413d
added missing file
2023-12-06 19:54:21 -05:00
Michael Chung
af6370eea1
Issue with the api doc not sure.
2023-12-06 19:53:52 -05:00
Michael Chung
3a4ca7b548
weights doc complete.
2023-12-06 16:14:08 -05:00
Michael Chung
f7d5ad496c
Update docs
2023-12-06 14:01:31 -05:00
Brandon Thomas
8a6678c7f5
move workspace-hack under crates/
2023-12-06 02:12:57 -05:00
Michael Chung
f76928d001
Delete weight documentation added
2023-12-06 01:28:54 -05:00
Michael Chung
32cfb10323
added weights list documentation
2023-12-06 00:55:28 -05:00
Brandon Thomas
d9b1c8c36b
Merge pull request #192 from storytold/brandon-upgrade-chrono-vendored-limitation
...
upgrade chrono with vendored limitation
2023-12-05 21:54:36 -05:00
Brandon Thomas
fc122cb996
upgrade chrono with vendored limitation
2023-12-05 21:54:06 -05:00
Michael Chung
08d3c389b9
Merge branch 'master' into feature/weights_endpoints
2023-12-05 21:48:14 -05:00
Michael Chung
1a3b02b5d2
Adding docs
2023-12-05 21:46:53 -05:00
Brandon Thomas
e0e85fed5f
Merge pull request #191 from storytold/brandon-vendor-limitation
...
vendor `limitation` crate
2023-12-05 20:58:27 -05:00
Brandon Thomas
092745166e
vendor limitation crate
...
The limitation crate is four years old, stuck at 0.1.1. It looks unlikey
to be updated by the maintainer.
Upgrades to chrono and other libraries have broken limitation, so we're
likely now on the hook for maintaining this.
2023-12-05 20:56:22 -05:00
Michael Chung
024b4d769c
Merge branch 'master' into feature/weights_endpoints
2023-12-05 20:41:44 -05:00
Brandon Thomas
ea859bfc1e
Merge pull request #190 from storytold/brandon-revert-chrono-upgrade
...
Revert "Bump chrono from 0.4.22 to 0.4.31"
2023-12-05 20:40:37 -05:00
Brandon Thomas
92e0b1e9f4
Revert "Bump chrono from 0.4.22 to 0.4.31"
...
This reverts commit 4856ac28aa .
2023-12-05 20:40:09 -05:00
ArEnSc
d52d3f993a
Merge pull request #189 from storytold/feature/api-spec
...
Feature/api spec
2023-12-05 20:27:57 -05:00
Michael Chung
0033af73ce
Feedback addressed!
2023-12-05 20:26:07 -05:00
Brandon Thomas
514f80b884
Merge pull request #184 from storytold/dependabot/cargo/rustix-0.38.26
...
Bump rustix from 0.38.25 to 0.38.26
2023-12-05 19:22:24 -05:00
Brandon Thomas
74c548c02f
Merge pull request #182 from storytold/dependabot/cargo/chrono-0.4.31
...
Bump chrono from 0.4.22 to 0.4.31
2023-12-05 19:21:53 -05:00
Brandon Thomas
5fe09a182f
Merge pull request #185 from storytold/dependabot/cargo/lettre-0.11.2
...
Bump lettre from 0.11.1 to 0.11.2
2023-12-05 19:21:40 -05:00
dependabot[bot]
4856ac28aa
Bump chrono from 0.4.22 to 0.4.31
...
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.22 to 0.4.31.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/main/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.22...v0.4.31 )
---
updated-dependencies:
- dependency-name: chrono
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-06 00:19:36 +00:00
Brandon Thomas
404853e129
cleanup misleading old comment
2023-12-05 19:16:55 -05:00
Michael Chung
b5fcc3cdfa
Added documentation about the documentation
2023-12-05 19:14:02 -05:00
Brandon Thomas
300ac56ab7
Merge pull request #188 from storytold/brandon-media-files-global-list-fixed
...
global list of media files
2023-12-05 19:11:20 -05:00
Brandon Thomas
e32f8094e5
global list of media files
2023-12-05 19:09:42 -05:00
Michael Chung
e986a44e9d
documentation system open api spec.
2023-12-05 19:00:44 -05:00
Brandon Thomas
642e17a77d
Merge pull request #187 from storytold/brandon-fix-sqlx-query-builder
...
Fix QueryBuilder with respect to column names and type juggling
2023-12-05 18:31:13 -05:00
Brandon Thomas
36f3003576
Fix QueryBuilder with respect to column names and type juggling
2023-12-05 18:30:26 -05:00
Michael Chung
4993410740
Built needs a simple endpoint query test
2023-12-05 14:54:32 -05:00
Michael Chung
f99b5a92b8
Added weights paging to michael's spec missing the fields.
2023-12-05 13:44:50 -05:00
Brandon Thomas
b9f604dd18
reusable pagination types
2023-12-04 23:11:41 -05:00
Michael Chung
130e0daa08
paging works correctly.
2023-12-04 22:49:33 -05:00
Brandon Thomas
e6f5ecb980
Merge pull request #186 from storytold/brandon-list-media-files-for-user
...
list media files for user
2023-12-04 22:02:53 -05:00
Brandon Thomas
2e3ff8a730
list media files for user
2023-12-04 21:59:39 -05:00
Michael Chung
cda690773f
Merge branch 'master' into feature/weights_endpoints
2023-12-04 18:26:24 -05:00
Michael Chung
91d0a1da8f
Tests pass again
2023-12-04 18:21:43 -05:00
Michael Chung
8c7b100150
Adding new seed then have to switch tests back.
2023-12-04 18:06:11 -05:00
dependabot[bot]
ac13be2900
Bump lettre from 0.11.1 to 0.11.2
...
Bumps [lettre](https://github.com/lettre/lettre ) from 0.11.1 to 0.11.2.
- [Release notes](https://github.com/lettre/lettre/releases )
- [Changelog](https://github.com/lettre/lettre/blob/master/CHANGELOG.md )
- [Commits](https://github.com/lettre/lettre/compare/v0.11.1...v0.11.2 )
---
updated-dependencies:
- dependency-name: lettre
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-04 22:30:26 +00:00
dependabot[bot]
b55435d992
Bump rustix from 0.38.25 to 0.38.26
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.38.25 to 0.38.26.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.38.25...v0.38.26 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-12-04 22:30:06 +00:00
Brandon Thomas
28770ef736
fix query issue
2023-12-04 05:00:46 -05:00
Michael Chung
ae5eea53fe
Something wrong with the query parameters not passing off the limits etc
2023-12-04 03:57:40 -05:00
Brandon Thomas
894084fba6
Merge pull request #181 from storytold/brandon-queue-controls
...
Kill inference jobs (mod endpoint)
2023-12-04 03:54:05 -05:00
Brandon Thomas
4bf1a25fbb
Kill inference jobs (mod endpoint)
2023-12-04 03:46:29 -05:00
Michael Chung
241f648baf
Add type filtering in there and category filtering
2023-12-04 03:38:51 -05:00
Michael Chung
e4756a4f2c
Added more data seeding to the database for the model_weights table.
2023-12-04 01:52:14 -05:00
Michael Chung
9c8ee8dbbb
Ok list_weights_by_user works properly now.
2023-12-03 22:55:56 -05:00
Michael Chung
8072d13596
Fixed Delete and Updates for Weights
2023-12-03 01:35:04 -05:00
Michael Chung
1d937ab981
Initial weights_endpoints need testing right now.
2023-12-01 15:22:32 -05:00
Brandon Thomas
b0a9342194
updated queue stats
2023-12-01 07:09:23 -05:00
Brandon Thomas
3cc1ea6935
capture stderr for svc and rvc
2023-12-01 01:36:33 -05:00
Michael Chung
496ccd68f1
Working on uploads gonna be testing the endpoints soon.
...
Need a ui for the upload page to understand how to write it but it's similar to prior art just need to check that out.
2023-11-30 23:05:02 -05:00
Brandon Thomas
b74cf7853d
fix web break
2023-11-30 22:46:35 -05:00
Michael Chung
72fdd75568
added upload weights / create weight endpoint
...
original file for the weights
weights file type for safetensors or checkpoint
Gotta add one more thing for record creation
2023-11-30 17:33:25 -05:00
Brandon Thomas
3cdce86162
warn on slow batch queries
2023-11-30 17:25:23 -05:00
Brandon Thomas
b0a87e83a0
log batch index
2023-11-30 17:19:23 -05:00
Brandon Thomas
979c234ed2
cleanup logging
2023-11-30 16:27:25 -05:00
Brandon Thomas
4837106d37
distinguish logs
2023-11-30 16:10:01 -05:00
Brandon Thomas
cfd92e814d
Merge pull request #166 from storytold/dependabot/cargo/env_logger-0.10.1
...
Bump env_logger from 0.7.1 to 0.10.1
2023-11-30 16:02:23 -05:00
Brandon Thomas
6d27214a14
codegen
2023-11-30 15:50:05 -05:00
Brandon Thomas
b628fb0a11
premium TTS duration
2023-11-30 15:21:07 -05:00
dependabot[bot]
456b9e1ce6
Bump env_logger from 0.7.1 to 0.10.1
...
Bumps [env_logger](https://github.com/rust-cli/env_logger ) from 0.7.1 to 0.10.1.
- [Release notes](https://github.com/rust-cli/env_logger/releases )
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md )
- [Commits](https://github.com/rust-cli/env_logger/compare/v0.7.1...v0.10.1 )
---
updated-dependencies:
- dependency-name: env_logger
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-30 09:35:18 +00:00
Brandon Thomas
6f7b6da595
Merge pull request #167 from storytold/dependabot/cargo/rand-0.8.5
...
Bump rand from 0.7.3 to 0.8.5
2023-11-30 04:33:54 -05:00
Brandon Thomas
18ad28135f
safe delete
2023-11-30 02:36:33 -05:00
Brandon Thomas
ff4a3115d2
clear up more directories when file system is full
2023-11-30 02:34:33 -05:00
dependabot[bot]
ccae943037
Bump rand from 0.7.3 to 0.8.5
...
Bumps [rand](https://github.com/rust-random/rand ) from 0.7.3 to 0.8.5.
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-random/rand/compare/0.7.3...0.8.5 )
---
updated-dependencies:
- dependency-name: rand
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-30 07:32:36 +00:00
Brandon Thomas
12ef105ced
fix errors
2023-11-30 02:27:08 -05:00
Brandon Thomas
b27070e23e
get rid of more of container_common
2023-11-30 02:25:16 -05:00
Brandon Thomas
8e45a4ea45
delete mod
2023-11-30 02:05:15 -05:00
Brandon Thomas
a669ac7f03
move remaining container_common::files -> filesys crate
2023-11-30 02:04:41 -05:00
Brandon Thomas
b5ed9acdd4
move check_directory_exists to filesys crate
2023-11-30 01:56:55 -05:00
Brandon Thomas
ff2aaa9f3d
move check_file_exists to filesys crate
2023-11-30 01:53:42 -05:00
Brandon Thomas
f93421eadc
keep IoError around; better casting
2023-11-30 01:35:48 -05:00
Brandon Thomas
b82ffcce86
much more StorageFull error !
2023-11-30 01:26:03 -05:00
Brandon Thomas
e2c5839d01
surface storage full errors
2023-11-30 01:05:26 -05:00
Michael Chung
fba7d2a1eb
needs some tests for users and query builds with pagination
2023-11-30 00:48:54 -05:00
Michael Chung
347fe685cd
List list_availible_weights needs testing but is written.
2023-11-29 23:11:47 -05:00
Brandon Thomas
896e8591ba
cleanup
2023-11-29 23:10:15 -05:00
Brandon Thomas
19dcfdc629
cleanup
2023-11-29 22:51:12 -05:00
Brandon Thomas
cec7bce450
try copy instead
2023-11-29 22:49:00 -05:00
Brandon Thomas
6cc3062da8
don't fail if file is gone (not sure why this happens)
2023-11-29 22:01:53 -05:00
Brandon Thomas
efdd03bbbd
logging
2023-11-29 21:50:30 -05:00
Michael Chung
32331f9890
compiles working on list queries
2023-11-29 21:46:42 -05:00
Brandon Thomas
c207356ac5
cleanup retry
2023-11-29 21:44:20 -05:00
Brandon Thomas
3243cc51b7
try to delete and re-copy
2023-11-29 21:36:47 -05:00
Brandon Thomas
ee4af2976f
flag to permit cold filesystem cache
2023-11-29 21:26:03 -05:00
Brandon Thomas
4fb2a38c68
report temp file size
2023-11-29 21:10:01 -05:00
Brandon Thomas
a549ceb609
check vocoder and synthesizer sizes
2023-11-29 20:53:00 -05:00
Brandon Thomas
003f0cdeea
struct args for downloader (safer)
2023-11-29 20:46:33 -05:00
Brandon Thomas
9e0772141a
download file size check and logging
2023-11-29 20:25:37 -05:00
Brandon Thomas
542b79dd90
log http errors
2023-11-29 19:49:52 -05:00
Brandon Thomas
363f8cbc96
debug log statements, FileCacheDir (not yet used)
2023-11-29 19:28:32 -05:00
Brandon Thomas
f2e75f8637
rename files across fs devices
2023-11-29 18:46:00 -05:00
Brandon Thomas
f48cbb7978
fix
2023-11-29 18:16:45 -05:00
Brandon Thomas
edd5cd6156
Merge pull request #179 from storytold/brandon-fix-job-pathing
...
Brandon fix job pathing
2023-11-29 17:49:39 -05:00
Brandon Thomas
37c016cecb
"semi persistent dir" needs cleanup, this is confusing
2023-11-29 17:48:29 -05:00
Brandon Thomas
1a3e111dd6
Fix job pathing for outage and to make easier to manage
2023-11-29 17:30:03 -05:00
Michael Chung
65d6f178bc
WIP - weights endpoints need to be tested
...
Update weights endpoints had to be fixed.
should be ready to unit test the 3 endpoints before using the list weights
2023-11-29 17:07:18 -05:00
Brandon Thomas
0c456d957c
fix build errors
2023-11-29 15:46:43 -05:00
kasisnu
133ccff348
update media file visibilty handler
2023-11-29 17:12:22 +05:30
Brandon Thomas
85ecce7b38
comments
2023-11-29 03:07:07 -05:00
Brandon Thomas
2f1d682438
Merge pull request #176 from storytold/nov-29-mithoo
...
fail model deleted inference jobs
2023-11-29 02:44:38 -05:00
Brandon Thomas
c6fbfaa6ba
fix test failures and nits
2023-11-29 02:43:31 -05:00
Brandon Thomas
038401bff4
Merge pull request #177 from storytold/brandon-revert-sha2-bump
...
Revert "Bump sha2 from 0.9.9 to 0.10.8"
2023-11-29 02:29:16 -05:00
Brandon Thomas
e1c7231d96
Revert "Bump sha2 from 0.9.9 to 0.10.8"
...
This reverts commit 951afc2e5d .
2023-11-29 02:28:51 -05:00
kasisnu
1e11fdb35d
fail model deleted inference jobs
2023-11-29 12:43:49 +05:30
Brandon Thomas
74c477b045
Merge pull request #169 from storytold/dependabot/cargo/sha2-0.10.8
...
Bump sha2 from 0.9.9 to 0.10.8
2023-11-28 21:37:50 -05:00
Brandon Thomas
042fa1574d
Merge pull request #168 from storytold/dependabot/cargo/time-0.3.30
...
Bump time from 0.2.27 to 0.3.30
2023-11-28 21:37:26 -05:00
Brandon Thomas
4387e6326f
LFU cache in TT2 inference-job
2023-11-28 17:47:46 -05:00
Michael Chung
d9d166e500
Run routes using open api spec
2023-11-28 17:27:32 -05:00
dependabot[bot]
a3ab634725
Bump openssl in /old_code/twitch-tts-desktop-client
...
Bumps [openssl](https://github.com/sfackler/rust-openssl ) from 0.10.36 to 0.10.60.
- [Release notes](https://github.com/sfackler/rust-openssl/releases )
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.36...openssl-v0.10.60 )
---
updated-dependencies:
- dependency-name: openssl
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-28 21:11:08 +00:00
dependabot[bot]
93ebe101f3
Bump openssl in /old_code/twitter-ingestion-client
...
Bumps [openssl](https://github.com/sfackler/rust-openssl ) from 0.10.34 to 0.10.60.
- [Release notes](https://github.com/sfackler/rust-openssl/releases )
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.34...openssl-v0.10.60 )
---
updated-dependencies:
- dependency-name: openssl
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-28 21:03:53 +00:00
dependabot[bot]
0128134d3d
Bump openssl from 0.10.33 to 0.10.60 in /old_code/pubsub-enricher
...
Bumps [openssl](https://github.com/sfackler/rust-openssl ) from 0.10.33 to 0.10.60.
- [Release notes](https://github.com/sfackler/rust-openssl/releases )
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.33...openssl-v0.10.60 )
---
updated-dependencies:
- dependency-name: openssl
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-28 21:02:17 +00:00
dependabot[bot]
da15968c4e
Bump openssl in /old_code/twitch-ingestion-client
...
Bumps [openssl](https://github.com/sfackler/rust-openssl ) from 0.10.32 to 0.10.60.
- [Release notes](https://github.com/sfackler/rust-openssl/releases )
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.32...openssl-v0.10.60 )
---
updated-dependencies:
- dependency-name: openssl
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-28 21:00:56 +00:00
Brandon Thomas
3ad2b744b7
test comment out Dockerfile /etc/ssl copy
2023-11-28 15:42:24 -05:00
Brandon Thomas
8bf85b637b
notes on dependencies
2023-11-28 15:40:26 -05:00
Brandon Thomas
50c3b5ed65
codegen db
2023-11-28 15:23:43 -05:00
Brandon Thomas
df15395bf7
fix build error
2023-11-28 15:08:39 -05:00
Brandon Thomas
5666d58da0
fix SSL problem?
2023-11-28 14:54:53 -05:00
dependabot[bot]
0a85e9c581
Bump time from 0.2.27 to 0.3.30
...
Bumps [time](https://github.com/time-rs/time ) from 0.2.27 to 0.3.30.
- [Release notes](https://github.com/time-rs/time/releases )
- [Changelog](https://github.com/time-rs/time/blob/main/CHANGELOG.md )
- [Commits](https://github.com/time-rs/time/compare/v0.2.27...v0.3.30 )
---
updated-dependencies:
- dependency-name: time
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-28 16:45:21 +00:00
ArEnSc
bd0ce25d94
Merge pull request #151 from storytold/feature/weights_queries
...
Feature/weights queries
2023-11-28 11:43:00 -05:00
ArEnSc
9f2335bfba
Merge branch 'master' into feature/weights_queries
2023-11-28 11:30:22 -05:00
Brandon Thomas
63eca62f1d
ssl to GCS broken in production, maybe this fixes?
2023-11-28 11:01:36 -05:00
Brandon Thomas
2808d20a35
fix wrong cleanup
2023-11-28 08:43:00 -05:00
Brandon Thomas
2d67947479
comment
2023-11-28 08:39:54 -05:00
Brandon Thomas
9722a34c8b
extra care to delete temp directories
2023-11-28 08:37:08 -05:00
Brandon Thomas
643dffc08c
scoped TempDir
2023-11-28 08:23:43 -05:00
Brandon Thomas
1433eca29a
queue stats for inference-job's tacotron2
2023-11-28 07:27:26 -05:00
Brandon Thomas
8176f0d6bd
fix lints
2023-11-28 06:26:17 -05:00
Brandon Thomas
2cfcbf8a75
db codegen + fix build errors
2023-11-28 06:19:37 -05:00
Brandon Thomas
fb9a9b75bf
Merge pull request #171 from storytold/brandon-tts-on-inference-job
...
tts-inference-job --> inference-job
2023-11-28 05:51:58 -05:00
Brandon Thomas
2a1675d865
formatting
2023-11-28 05:42:50 -05:00
Brandon Thomas
f672df7386
add TT2 HTTP sidecar health checking (hacky)
2023-11-28 05:11:43 -05:00
Brandon Thomas
59fc891ce4
filter out certain model types (so we don't leak to competitors)
2023-11-28 02:59:01 -05:00
Brandon Thomas
739f234ac3
emulate TTS Results in media file pages
2023-11-28 02:42:55 -05:00
Michael Chung
8303066c38
Added serial test to run the database tests in serial, prevent failing when running the suite.
2023-11-28 00:16:44 -05:00
Michael Chung
5feb500b5e
unit test for paging
2023-11-27 23:16:43 -05:00
Brandon Thomas
626157b615
emulate TTS inference job status checking for generic jobs
2023-11-27 22:19:27 -05:00
Brandon Thomas
7f3ccdc53d
cleanup dependency checking
2023-11-27 21:22:27 -05:00
Brandon Thomas
cc1d7f6de1
theoretically TTS HTTP works with inference-job
2023-11-27 20:55:13 -05:00
Brandon Thomas
3d4a870190
streamline inference-job tt2
2023-11-27 20:55:13 -05:00
Brandon Thomas
824d113dfc
port some dependencies of tts-inference-job to inference-job
2023-11-27 20:55:13 -05:00
Brandon Thomas
eaadc8242d
remove (unused) tts-inference-job shell out code
2023-11-27 20:55:13 -05:00
Brandon Thomas
bf5dddf6a9
Merge pull request #170 from storytold/brandon-seed-tt2-models
...
seed tool: TT2 models (with idempotency + early exit)
2023-11-27 20:50:31 -05:00
Brandon Thomas
22051f2dba
make idempotent
2023-11-27 20:42:37 -05:00
Brandon Thomas
d777346520
Update seed tool to seed TT2 models
2023-11-27 18:31:42 -05:00
dependabot[bot]
951afc2e5d
Bump sha2 from 0.9.9 to 0.10.8
...
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.9.9 to 0.10.8.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.9...sha2-v0.10.8 )
---
updated-dependencies:
- dependency-name: sha2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-27 22:32:08 +00:00
Michael Chung
d990fd4bfa
Merge branch 'feature/weights_queries' of https://github.com/storytold/storyteller-rust into feature/weights_queries
2023-11-27 12:12:02 -05:00
Michael Chung
6f5edf0c96
fixed issues with weights queries and the tests, tests slightly flaky need to have it delete the rows, and ensure it doesn't run in prod.
2023-11-27 12:09:34 -05:00
ArEnSc
b99756a7d1
Merge pull request #165 from storytold/nov-27-mithoo
...
query builder quickfix
2023-11-27 11:23:13 -05:00
kasisnu
dcbdaf9cd6
query builder quickfix
2023-11-27 17:47:55 +05:30
Michael Chung
8e4f419091
QiueryBuilder tests needed
2023-11-27 00:46:46 -05:00
Michael Chung
b779946fe7
Queries pass need just some mock data to test it in the test.rs
2023-11-26 15:29:57 -05:00
Michael Chung
a244e614cf
need to run tests on the query builder then can work on the rest of the code
2023-11-26 14:22:42 -05:00
Michael Chung
2e6708168b
building wip ... then test then endpoints probably need seed data for this that is a bit diverse.
2023-11-25 03:53:19 -05:00
Michael Chung
8c46f47352
queries building is wip.
2023-11-25 03:28:34 -05:00
Michael Chung
fdbf028743
test works query builder now.
2023-11-25 02:40:46 -05:00
Michael Chung
becf58a357
Time to test.
2023-11-25 01:51:02 -05:00
Michael Chung
a4c227a4ca
Fixes to the weights now need filter
2023-11-25 01:40:54 -05:00
Michael Chung
0e1e8a87f1
Mapping list_weights_by_user.rs done need filter and then test
2023-11-25 00:17:58 -05:00
Michael Chung
c9df278d40
weights_queries list weights by user more testing and implementation needed
2023-11-24 23:50:50 -05:00
Michael Chung
ddb35c5133
Added more data for seeding
...
Added to test lists need to get list_weights_by_user tested
2023-11-24 22:24:34 -05:00
Michael Chung
df3fc1bf51
more tests undelete and delete.
2023-11-24 00:35:43 -05:00
Michael Chung
21f2c3ac78
fixed weights queries get_weight hardcode transform
2023-11-24 00:19:21 -05:00
Michael Chung
be429017eb
Deleting weights from the database works for user
2023-11-23 23:34:14 -05:00
Michael Chung
2a623bd8eb
Ok just mapped this by hand, super dissapointed that I can't use the the proper way to do it for some unknown reason.
2023-11-23 22:46:28 -05:00
Michael Chung
8b2765ba65
Weight types is failing to serialize :S
2023-11-23 21:39:42 -05:00
Michael Chung
ccf1adae61
Add a test mod
2023-11-23 21:22:23 -05:00
Michael Chung
1a144ac8cf
Writing unit tests for the queries
2023-11-23 19:41:33 -05:00
Brandon Thomas
71581978ff
Merge pull request #162 from storytold/nov-21-mithoo
...
Bump actix & futures deps
2023-11-23 12:49:39 -05:00
Michael Chung
ce3aa6be74
model_weights delete need tests
2023-11-23 01:09:17 -05:00
Michael Chung
f63eb94ed7
update_weight needs testing
2023-11-23 00:46:11 -05:00
kasisnu
a987ae81cf
rebase codegen updates
2023-11-23 11:10:57 +05:30
kasisnu
684cd7df69
upgrade futures
2023-11-23 11:08:29 +05:30
kasisnu
703e297b94
easy bump actix deps
2023-11-23 11:08:29 +05:30
Michael Chung
2e4e109065
Notes
2023-11-22 23:41:16 -05:00
Michael Chung
8481d37167
Fixed compile errors.
2023-11-22 23:25:19 -05:00
Michael Chung
5ed397af4e
WIP get and update gotta write unit tests, WIP do not review.
2023-11-22 23:05:25 -05:00
Michael Chung
ccbc89fd3e
Fix function name issues
2023-11-22 13:21:52 -05:00
Brandon Thomas
62ce6d5991
codegen db
2023-11-22 03:07:13 -05:00
Brandon Thomas
e27871bd7e
Mark everything about BucketPathUnifier as deprecated. It sucks.
2023-11-22 02:27:48 -05:00
Brandon Thomas
106e3badc1
Merge pull request #163 from storytold/brandon-inference-job-startup-cleanup
...
Scoped inference jobs shouldn't require all parameters
2023-11-22 02:21:55 -05:00
Brandon Thomas
bcc91080e6
reorganize dependencies
2023-11-22 02:20:11 -05:00
Brandon Thomas
9848688a69
make container startup easier to parse
2023-11-21 22:45:04 -05:00
Brandon Thomas
5e2f85964c
vits dependencies
2023-11-21 22:18:32 -05:00
Brandon Thomas
8c17cd4415
vall-e-x dependencies
2023-11-21 21:54:32 -05:00
Brandon Thomas
58ce32dcbb
tacotron2
2023-11-21 21:45:55 -05:00
Brandon Thomas
2856be7aa9
SadTalker dependencies
2023-11-21 21:34:32 -05:00
Brandon Thomas
a28ef00618
cleanup job stubs we never implemented
2023-11-21 21:24:18 -05:00
Brandon Thomas
4941278590
SVC simplification
2023-11-21 20:06:33 -05:00
Michael Chung
5893753e35
Weights operations
2023-11-21 19:34:26 -05:00
Brandon Thomas
31ee410ac0
Cleanup Inference Job startup
...
- Don't require all env vars for all job types
2023-11-21 18:47:24 -05:00
Brandon Thomas
c256b14fe5
Merge pull request #158 from storytold/dependabot/cargo/tempfile-3.8.1
...
Bump tempfile from 3.3.0 to 3.8.1
2023-11-21 18:07:46 -05:00
Brandon Thomas
a2bd688ec2
Merge pull request #150 from storytold/dependabot/cargo/rustix-0.37.27
...
Bump rustix from 0.37.13 to 0.37.27
2023-11-21 18:07:20 -05:00
Brandon Thomas
2410be28c1
Merge pull request #159 from storytold/dependabot/cargo/num-traits-0.2.17
...
Bump num-traits from 0.2.15 to 0.2.17
2023-11-21 18:07:00 -05:00
Brandon Thomas
a1191aa2c3
Merge pull request #95 from storytold/oct-12-mithoo
...
super basic favorites impl
2023-11-21 18:03:58 -05:00
Brandon Thomas
2c502359a4
user favorites, entity favorites, etc. + minor changes
2023-11-21 18:02:32 -05:00
kasisnu
18bd819da2
zsvoice & VC models can be favorited
2023-11-21 14:59:28 -05:00
kasisnu
2614ba5eb9
remove ip address fields, and be able to favorite media files
2023-11-21 14:59:28 -05:00
kasisnu
b2bdf16c1c
update postman collection w/favoritesc
2023-11-21 14:59:27 -05:00
kasisnu
b436b07955
super basic favorites impl
2023-11-21 14:59:27 -05:00
Brandon Thomas
5da5908bea
Merge pull request #109 from storytold/oct-19-mithoo
...
delete media files/basic update handler
2023-11-21 13:24:22 -05:00
Brandon Thomas
58ea502400
Delete/update tweaks
2023-11-21 13:22:59 -05:00
kasisnu
3ed1f36e36
rebase updates with sqlx codegen
2023-11-21 13:14:43 -05:00
kasisnu
f958667cc4
delete media files/basic update handler
2023-11-21 13:14:43 -05:00
Kasisnu
87202f3ba2
Merge pull request #161 from storytold/nov-21-mithoo
...
disable speedup experiments on main workflows
2023-11-21 18:38:22 +05:30
kasisnu
b59bdc1ed5
disable speedup experiments on main workflows
2023-11-21 18:37:54 +05:30
Kasisnu
b68c7f415f
Merge pull request #160 from storytold/nov-21-mithoo
...
add new workflow
2023-11-21 13:34:53 +05:30
kasisnu
a08ebffeba
add new workflow
2023-11-21 13:33:20 +05:30
dependabot[bot]
7893acce0f
Bump num-traits from 0.2.15 to 0.2.17
...
Bumps [num-traits](https://github.com/rust-num/num-traits ) from 0.2.15 to 0.2.17.
- [Changelog](https://github.com/rust-num/num-traits/blob/master/RELEASES.md )
- [Commits](https://github.com/rust-num/num-traits/compare/num-traits-0.2.15...num-traits-0.2.17 )
---
updated-dependencies:
- dependency-name: num-traits
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-20 22:34:28 +00:00
dependabot[bot]
5dd3f7bf20
Bump tempfile from 3.3.0 to 3.8.1
...
Bumps [tempfile](https://github.com/Stebalien/tempfile ) from 3.3.0 to 3.8.1.
- [Changelog](https://github.com/Stebalien/tempfile/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Stebalien/tempfile/commits )
---
updated-dependencies:
- dependency-name: tempfile
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-20 22:33:55 +00:00
Kasisnu
f8a3a3b721
Merge pull request #157 from storytold/nov-20-mithoo
...
gpu build: copy result bins from updated directories
2023-11-20 15:47:35 +05:30
kasisnu
5895dc0b1f
gpu build: copy result bins from updated directories
2023-11-20 15:47:15 +05:30
kasisnu
75e19113da
x86_64-unknown-linux-musl -> x86_64-unknown-linux-gnu
2023-11-20 15:38:14 +05:30
Kasisnu
a7dcdf19ed
Merge pull request #156 from storytold/nov-20-mithoo
...
add --target=x86_64-unknown-linux-musl explicitly
2023-11-20 15:27:56 +05:30
kasisnu
8e415770fb
Merge remote-tracking branch 'origin/master' into nov-20-mithoo
2023-11-20 15:26:46 +05:30
kasisnu
28d64f29e2
sadpanda
2023-11-20 15:26:17 +05:30
Kasisnu
9da6be3320
Merge pull request #155 from storytold/nov-20-mithoo
...
statically build gpu binaries
2023-11-20 15:20:28 +05:30
kasisnu
49cec49844
statically build gpu binaries
2023-11-20 15:19:27 +05:30
Brandon Thomas
a2354cd64c
install rsync in containers (lazy, fix this)
...
This was a lazy way to add rsync into the containers to enable easy
copying of files + logging. This is not the ideal way to do this.
2023-11-20 01:20:09 -05:00
Kasisnu
809dabd253
Merge pull request #154 from storytold/nov-20-mithoo
...
trailing slash
2023-11-20 11:22:11 +05:30
kasisnu
0470811bb4
trailing slash
2023-11-20 11:21:50 +05:30
Kasisnu
fecb671400
Merge pull request #153 from storytold/nov-20-mithoo
...
sqlx codegen
2023-11-20 11:12:50 +05:30
kasisnu
6d82cb9de6
updated dockerfiles for sqlx codegen
2023-11-20 11:11:44 +05:30
kasisnu
0fdacfe295
sqlx codegen
2023-11-20 10:55:43 +05:30
Brandon Thomas
6a255330b4
Merge pull request #152 from storytold/brandon-rustls
...
Switch from native TLS to rustls
2023-11-20 00:10:20 -05:00
Brandon Thomas
e64fcab028
Switch from native TLS to rustls
...
This should make for smaller and simpler binaries.
2023-11-20 00:06:15 -05:00
Michael Chung
6026748563
Seeding Weights probably actually need real weights
2023-11-19 23:36:59 -05:00
dependabot[bot]
6cd48d2f5b
Bump rustix from 0.37.13 to 0.37.27
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.37.13 to 0.37.27.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.37.13...v0.37.27 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-20 04:34:25 +00:00
Brandon Thomas
b36283c76e
Merge pull request #149 from storytold/brandon-upgrade-sqlx-0.7.2
...
Upgrade sqlx to latest (0.7.2)
2023-11-19 23:32:22 -05:00
Brandon Thomas
bd4644098f
Upgrade sqlx to latest (0.7.2)
...
Hypothetically this unblocks native rustls over IP address. If so, we
can drop native OpenSSL and Ubuntu packages and make a much simpler
build.
See this issue:
https://github.com/launchbadge/sqlx/issues/1095#issuecomment-798050828
Had to deal with a few migration issues,
- changes to transactor types:
https://github.com/launchbadge/sqlx/issues/2606
- changes to sqlx_core that impacted our serialization/deserialization macros
2023-11-19 23:25:52 -05:00
Brandon Thomas
831b0eda29
Don't need this - let's invert the pod in control
2023-11-18 23:47:52 -05:00
Michael Chung
bffe8d39ae
model_weights/create_weight.rs being worked on
2023-11-18 00:44:41 -05:00
Michael Chung
c36ca5e73c
create model_weights
2023-11-17 23:59:53 -05:00
Michael Chung
55344fc6dd
Model Weight Queries has to be worked on categories and types tests written.
2023-11-17 23:39:55 -05:00
Brandon Thomas
0a9803af83
PLEAAASE BUILD
2023-11-17 11:29:27 -05:00
Brandon Thomas
0952d16a86
-y flag ?
2023-11-17 11:08:43 -05:00
Brandon Thomas
2ed43572e0
maybe patch 3.8 logger too
2023-11-17 10:34:16 -05:00
Brandon Thomas
72e67ed198
really install deadsnakes
2023-11-17 10:21:18 -05:00
Brandon Thomas
66774b0d31
python3.8 (this should only be temporary)
2023-11-17 10:14:04 -05:00
Brandon Thomas
d54cd75dec
unblock route
2023-11-17 08:48:13 -05:00
Brandon Thomas
23293e973f
codegen db
2023-11-17 03:42:01 -05:00
Brandon Thomas
5bb32d0adb
record millis and encoding
2023-11-17 03:16:40 -05:00
Brandon Thomas
d123a73069
confirm email when password reset
2023-11-17 02:48:24 -05:00
Brandon Thomas
f978c1f4cc
propagate avt to zero shot tts
2023-11-17 02:39:55 -05:00
Brandon Thomas
9d38440ae4
rename handler
2023-11-17 01:52:10 -05:00
Brandon Thomas
4530083333
more foreign key and field completion for samples
2023-11-17 01:49:03 -05:00
Brandon Thomas
23584b4462
Merge pull request #148 from storytold/brandon-vallex-pathing
...
Fix vallex pathing
2023-11-16 21:03:50 -05:00
Brandon Thomas
762cf2d0b4
pathing works
2023-11-16 21:02:54 -05:00
Brandon Thomas
7a4c035960
upload of weights works
2023-11-16 20:32:19 -05:00
Brandon Thomas
cd8ca0092b
modify bucket pathing
2023-11-16 20:07:14 -05:00
Brandon Thomas
c920ae5286
Merge pull request #147 from storytold/bt-split-vallex-to-files
...
split vallex tts inference + embedding creation
2023-11-16 19:06:55 -05:00
Brandon Thomas
61bb4162a3
split vallex tts inference + embedding creation
2023-11-16 19:06:16 -05:00
Brandon Thomas
a1c7db19e3
Merge pull request #146 from storytold/bt-better-error-logging-vallex
...
better error logging, pathing
2023-11-16 18:53:41 -05:00
Brandon Thomas
e6690fa133
better error logging, pathing
2023-11-16 18:52:56 -05:00
Brandon Thomas
c22f7fe654
Merge pull request #138 from storytold/dependabot/cargo/magic-crypt-3.1.13
...
Bump magic-crypt from 3.1.8 to 3.1.13
2023-11-16 17:56:54 -05:00
Brandon Thomas
bc94582138
Merge pull request #140 from storytold/dependabot/cargo/strum-0.25.0
...
Bump strum from 0.24.1 to 0.25.0
2023-11-16 17:56:18 -05:00
Brandon Thomas
b3226b04cb
Merge pull request #139 from storytold/dependabot/cargo/serde_json-1.0.108
...
Bump serde_json from 1.0.91 to 1.0.108
2023-11-16 17:56:05 -05:00
Michael Chung
afc0e27fb4
Made updates to the seed and the docs to reflect the new seed files.
2023-11-16 16:07:50 -05:00
Brandon Thomas
f338d57ef5
Merge pull request #145 from storytold/bt-zs-inference-cleanup
...
voice designer inference job cleanup
2023-11-16 15:01:26 -05:00
Brandon Thomas
419c202ec9
voice designer inference job cleanup
...
- paths were different between upload, inference, and seed tool
- errors aren't being appropriately handled (and there's still work to
do here)
2023-11-16 05:10:30 -05:00
dependabot[bot]
59c19b2927
Bump strum from 0.24.1 to 0.25.0
...
Bumps [strum](https://github.com/Peternator7/strum ) from 0.24.1 to 0.25.0.
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Peternator7/strum/commits )
---
updated-dependencies:
- dependency-name: strum
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-16 06:18:28 +00:00
dependabot[bot]
3adf92d4e5
Bump serde_json from 1.0.91 to 1.0.108
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.91 to 1.0.108.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.91...v1.0.108 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-16 06:17:36 +00:00
Brandon Thomas
04e2605240
fixup lint / test failures
2023-11-16 01:16:09 -05:00
Brandon Thomas
6186dcd89d
analytics on password resets
2023-11-16 01:06:03 -05:00
Brandon Thomas
0f3586746e
committing secrets is a sin
2023-11-16 00:45:47 -05:00
Brandon Thomas
f84c31de5b
success response fields
2023-11-16 00:03:01 -05:00
Brandon Thomas
a19cafbae0
parameterize SMTP account
2023-11-15 23:55:34 -05:00
Brandon Thomas
b45afab5ea
stupid fix
2023-11-15 23:18:41 -05:00
Brandon Thomas
6d24b4b49b
codegen db
2023-11-15 22:47:20 -05:00
Brandon Thomas
f9704f0da4
Merge pull request #144 from storytold/brandon-email-job
...
email-job
2023-11-15 22:34:43 -05:00
Brandon Thomas
c7c7c5b798
email-job
2023-11-15 22:31:18 -05:00
Brandon Thomas
462ed87a7b
Merge pull request #132 from storytold/brandon-model-weights
...
WIP / DNM - model_weights
2023-11-15 21:03:02 -05:00
Brandon Thomas
170f6772d7
rename migrations for better operational sequencing
2023-11-15 21:02:11 -05:00
Brandon Thomas
2b884ebe51
Move metadata into polymorphic join tables
2023-11-15 21:00:41 -05:00
Brandon Thomas
fec587d81e
"model_weights" to replace all of the various weights tables
2023-11-15 21:00:39 -05:00
dependabot[bot]
4aec1a2298
Bump magic-crypt from 3.1.8 to 3.1.13
...
Bumps [magic-crypt](https://github.com/magiclen/rust-magiccrypt ) from 3.1.8 to 3.1.13.
- [Commits](https://github.com/magiclen/rust-magiccrypt/compare/v3.1.8...v3.1.13 )
---
updated-dependencies:
- dependency-name: magic-crypt
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-16 01:31:31 +00:00
Brandon Thomas
1e3117789e
Merge pull request #143 from storytold/nov-15-mithoo
...
build fix, get endpoints for zs datasets/voices
2023-11-15 20:30:11 -05:00
kasisnu
a18ebc4db3
get endpoints for zs datasets & voices
2023-11-15 14:26:57 +05:30
kasisnu
6cc75df103
Merge remote-tracking branch 'origin/speedup-experiments' into nov-15-mithoo
2023-11-15 11:19:45 +05:30
kasisnu
297ce4e0ad
add hakari dep to dockerfile
2023-11-14 12:46:43 +05:30
kasisnu
235c0d6754
fix missing deps
2023-11-14 12:42:28 +05:30
Kasisnu
8cd8f45b6c
Merge pull request #142 from storytold/nov-12-mithoo
...
removing some unused creates
2023-11-14 12:37:04 +05:30
kasisnu
ee0526f499
add a second branch to test speedups
2023-11-14 12:35:50 +05:30
kasisnu
d84e497131
hakari deps
2023-11-14 12:32:54 +05:30
kasisnu
2eb5635c58
removing some unused creates
2023-11-14 12:31:37 +05:30
Brandon Thomas
dd3c87b712
don't leak accounts
2023-11-12 07:02:39 -05:00
Brandon Thomas
7dc7afd244
environmental reset link
2023-11-12 05:16:53 -05:00
Brandon Thomas
f1d3566f30
login after password reset
2023-11-12 04:24:47 -05:00
Brandon Thomas
3852851f65
'success' fields, cleanup
2023-11-12 02:52:26 -05:00
Brandon Thomas
bdd24c47fa
codegen db
2023-11-12 02:36:29 -05:00
Brandon Thomas
a31a72abb7
Merge pull request #137 from storytold/brandon-jake-password-reset
...
password reset
2023-11-12 02:27:56 -05:00
Brandon Thomas
34c90becbb
schema migrations for password reset
2023-11-12 02:26:38 -05:00
Brandon Thomas
a69d0f7b9a
redemption works
2023-11-11 19:56:23 -05:00
Brandon Thomas
e068af0e1c
wip redemption
2023-11-11 16:23:30 -05:00
Brandon Thomas
c6a111bb4c
smtp wired up
2023-11-11 14:53:58 -05:00
Brandon Thomas
9ce771f571
fix crockford-encoded entropy
2023-11-10 16:27:30 -05:00
Jacob Conley
5892fb1f14
Fixed implementation up to the point of sending the email
2023-11-10 16:14:24 -05:00
Jacob Conley
6bbf8a9b01
Changed e-mail library; still only partially implemented
2023-11-10 16:14:21 -05:00
Jacob Conley
16d6542911
Beginning password reset implementation
...
- Email send is not implemented yet
- All of this is still untested, clearly
2023-11-10 16:13:58 -05:00
Jacob Conley
1cc3c5eee4
Update more crockford_deprecated stuff for real this time
2023-11-10 16:12:42 -05:00
Jacob Conley
054d7db0a9
Update crockford_deprecated references
2023-11-10 16:12:41 -05:00
Jacob Conley
927337331e
Rename crockford crate to crockford_deprecated - Gotta update references
2023-11-10 16:12:41 -05:00
Kasisnu
50780926fb
Merge pull request #136 from storytold/nov-10-mithoo
...
fix various stripe handler errors :(
2023-11-10 15:05:33 +05:30
kasisnu
2ebd6dc634
fix various stripe handler errors :(
2023-11-10 15:05:02 +05:30
Kasisnu
c5d5a4ba08
Merge pull request #135 from storytold/nov-10-mithoo
...
feat: report errors to stripe
2023-11-10 13:59:40 +05:30
kasisnu
797332b887
feat: report errors to stripe
2023-11-10 13:59:19 +05:30
Kasisnu
30d71ad605
Merge pull request #134 from storytold/nov-10-mithoo
...
audio mp4 uploads on ios
2023-11-10 13:47:15 +05:30
kasisnu
889121a818
audio mp4 uploads on ios
2023-11-10 13:46:39 +05:30
Brandon Thomas
293f531a79
Merge pull request #133 from storytold/lru-delete-models
...
Delete models from AWS EFS host
2023-11-10 00:36:21 -05:00
Brandon Thomas
fc344557be
Delete models from AWS EFS host
2023-11-10 00:35:36 -05:00
Brandon Thomas
a34785c308
Merge pull request #128 from storytold/dependabot/cargo/hyper-0.14.24
...
Bump hyper from 0.13.10 to 0.14.24
2023-11-09 13:44:41 -05:00
Brandon Thomas
7d6aec158c
Merge pull request #114 from storytold/dependabot/cargo/derive_more-0.99.17
...
Bump derive_more from 0.99.14 to 0.99.17
2023-11-09 13:42:14 -05:00
Brandon Thomas
861faafe60
Merge pull request #127 from storytold/dependabot/cargo/subprocess-0.2.9
...
Bump subprocess from 0.2.7 to 0.2.9
2023-11-09 13:42:05 -05:00
Brandon Thomas
5240d3cde5
Merge pull request #129 from storytold/dependabot/cargo/futures-util-0.3.29
...
Bump futures-util from 0.3.28 to 0.3.29
2023-11-09 13:41:56 -05:00
Brandon Thomas
8b962dcf6d
notes on vocoder_models table
2023-11-09 00:45:30 -05:00
dependabot[bot]
e2c3aedfb8
Bump hyper from 0.13.10 to 0.14.24
...
Bumps [hyper](https://github.com/hyperium/hyper ) from 0.13.10 to 0.14.24.
- [Release notes](https://github.com/hyperium/hyper/releases )
- [Changelog](https://github.com/hyperium/hyper/blob/v0.14.24/CHANGELOG.md )
- [Commits](https://github.com/hyperium/hyper/compare/v0.13.10...v0.14.24 )
---
updated-dependencies:
- dependency-name: hyper
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-08 17:31:45 +00:00
dependabot[bot]
e9605ea6af
Bump futures-util from 0.3.28 to 0.3.29
...
Bumps [futures-util](https://github.com/rust-lang/futures-rs ) from 0.3.28 to 0.3.29.
- [Release notes](https://github.com/rust-lang/futures-rs/releases )
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.28...0.3.29 )
---
updated-dependencies:
- dependency-name: futures-util
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-08 17:31:22 +00:00
Brandon Thomas
c6c708827b
Merge pull request #131 from storytold/nov-08-mithoo
...
bump async-stripe, dealing with webhook handler failures/updates
2023-11-08 12:29:03 -05:00
kasisnu
c9b3ce06d6
bump async-stripe, dealing with webhook handler failures/updates
2023-11-08 15:17:06 +05:30
Kasisnu
e4faf58990
Merge pull request #130 from storytold/nov-08-mithoo
...
iphone audio mimetype
2023-11-08 12:08:58 +05:30
kasisnu
d77c5e1885
iphone audio mimetype
2023-11-08 12:08:17 +05:30
Brandon Thomas
4930629a3a
fix lint and test failures
2023-11-07 22:33:38 -05:00
Brandon Thomas
331a0ce518
codegen db
2023-11-07 21:55:31 -05:00
Brandon Thomas
7aaa70bb31
more voice takedowns
2023-11-07 21:41:02 -05:00
Brandon Thomas
81d54291d1
Add README notes for Mac; streamline README
2023-11-02 01:14:48 -04:00
Brandon Thomas
77a2cc3439
dynamically flag off voice designer in production
2023-11-01 05:47:59 -04:00
Brandon Thomas
2882128a5c
todo
2023-11-01 04:38:06 -04:00
Brandon Thomas
0150715d63
setup for Windows Subsystem for Linux
2023-11-01 02:38:08 -04:00
Brandon Thomas
d63f5a8728
reorganize readme
2023-10-31 22:49:23 -04:00
dependabot[bot]
dcd77e53aa
Bump subprocess from 0.2.7 to 0.2.9
...
Bumps [subprocess](https://github.com/hniksic/rust-subprocess ) from 0.2.7 to 0.2.9.
- [Commits](https://github.com/hniksic/rust-subprocess/compare/release/0.2.7...release/0.2.9 )
---
updated-dependencies:
- dependency-name: subprocess
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-30 23:12:08 +00:00
Brandon Thomas
10ce570aa9
Merge pull request #126 from storytold/brandon-zs-endpoint-refinement
...
Brandon zs endpoint refinement
2023-10-30 18:29:43 -04:00
Brandon Thomas
fa3244c72b
fix iPhone audio/mp4 bug
2023-10-30 15:12:42 -04:00
Brandon Thomas
7a6a3840c3
return more fields on "list all voices"
2023-10-30 04:26:39 -04:00
Brandon Thomas
30760e29d6
list datasets by session handler; more cleanup
2023-10-30 04:14:55 -04:00
Brandon Thomas
3c025c506e
add "list voices by session" endpoint; misc cleanup
2023-10-30 03:41:56 -04:00
Brandon Thomas
8dd5661923
remove more
2023-10-29 12:39:35 -04:00
Brandon Thomas
0bcdaa0d2d
missed one
2023-10-29 12:35:20 -04:00
Brandon Thomas
c5efc9e0c8
RVC takedown requests
2023-10-29 12:33:45 -04:00
Brandon Thomas
b8c85b7e91
minor tweak to threading
2023-10-28 20:52:30 -04:00
Brandon Thomas
29e556c311
rename with kebob-case
2023-10-28 20:27:02 -04:00
Brandon Thomas
dc735c01a0
rust 1.66 -> 1.73 (required update)
2023-10-27 06:13:06 -04:00
Brandon Thomas
7d66279d70
fix nits
2023-10-27 06:09:21 -04:00
Brandon Thomas
d6de7acc5c
codegen db
2023-10-27 05:58:34 -04:00
Brandon Thomas
5da6cee74c
Merge pull request #124 from storytold/brandon-elasticsearch
...
Introduce elasticsearch database + tools
2023-10-27 05:56:20 -04:00
Brandon Thomas
e4607fe658
Introduce elasticsearch database + tools
2023-10-27 05:56:00 -04:00
Brandon Thomas
4def45d769
Merge pull request #123 from storytold/brandon-revert-sha2-upgrade
...
Revert "Bump sha2 from 0.9.5 to 0.10.5"
2023-10-26 00:01:30 -04:00
Brandon Thomas
b6f7f50b16
Revert "Bump sha2 from 0.9.5 to 0.10.5"
...
This reverts commit b9667e2540 .
2023-10-25 23:52:40 -04:00
Brandon Thomas
8af1a2da47
Merge pull request #115 from storytold/dependabot/cargo/sha2-0.10.5
...
Bump sha2 from 0.9.5 to 0.10.5
2023-10-25 23:50:32 -04:00
dependabot[bot]
995c912e94
Bump derive_more from 0.99.14 to 0.99.17
...
Bumps [derive_more](https://github.com/JelteF/derive_more ) from 0.99.14 to 0.99.17.
- [Release notes](https://github.com/JelteF/derive_more/releases )
- [Changelog](https://github.com/JelteF/derive_more/blob/master/CHANGELOG.md )
- [Commits](https://github.com/JelteF/derive_more/compare/v0.99.14...v0.99.17 )
---
updated-dependencies:
- dependency-name: derive_more
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-26 03:50:14 +00:00
Brandon Thomas
c018001693
Merge pull request #116 from storytold/dependabot/cargo/pulldown-cmark-0.9.3
...
Bump pulldown-cmark from 0.8.0 to 0.9.3
2023-10-25 23:48:38 -04:00
Brandon Thomas
3f54396ef4
Merge pull request #118 from storytold/dependabot/cargo/actix-http-3.4.0
...
Bump actix-http from 3.3.0 to 3.4.0
2023-10-25 23:48:14 -04:00
Brandon Thomas
85eed593d0
Merge pull request #122 from storytold/voice-designer-concrete-types
...
more concrete types for "enum"-like fields, remove unnecessary updates
2023-10-25 23:47:21 -04:00
Brandon Thomas
50a0cb298d
more concrete types for "enum"-like fields, remove unnecessary updates
2023-10-25 23:39:42 -04:00
Brandon Thomas
b11ad51d8e
rename enum serialization
2023-10-25 17:01:17 -04:00
Brandon Thomas
b0aae47328
rename some IdCategory enum values (not serializations)
2023-10-25 16:58:45 -04:00
Brandon Thomas
a6c4c10a9a
fix tests and lints
2023-10-25 16:46:19 -04:00
ArEnSc
7b31887891
Merge pull request #94 from storytold/feature/enqueue_tts_request
...
Feature/enqueue tts request
2023-10-25 11:58:31 -04:00
Michael Chung
8a5e4538a0
All good! going to merge now.
2023-10-25 11:32:22 -04:00
Brandon Thomas
37129a6d01
better documentation
2023-10-25 04:04:51 -04:00
Brandon Thomas
7731c534a3
restructure tokens package to organize prefixes
...
Tests enforce the new style, which wasn't possible before
2023-10-25 03:57:19 -04:00
dependabot[bot]
b9667e2540
Bump sha2 from 0.9.5 to 0.10.5
...
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.9.5 to 0.10.5.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.5...sha2-v0.10.5 )
---
updated-dependencies:
- dependency-name: sha2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-25 07:03:42 +00:00
Brandon Thomas
9aeca4aa90
Finally 'Tokens::' methods are dead!
2023-10-25 03:02:14 -04:00
Brandon Thomas
f40a292b1e
todo
2023-10-25 00:59:27 -04:00
Brandon Thomas
d90df6f8b8
change billing token to typed token
2023-10-25 00:55:54 -04:00
Brandon Thomas
92c76d2bb9
get rid of more legacy tokens
2023-10-25 00:49:12 -04:00
Brandon Thomas
9b5bb16358
continue getting rid of Token in the mysql package
2023-10-25 00:14:11 -04:00
Brandon Thomas
03135fa781
investigate use of face animator
2023-10-24 23:48:13 -04:00
Michael Chung
3f70ca72dd
Dev environment
...
Fixed various code problems, going to merge soon.
2023-10-24 13:09:36 -04:00
Michael Chung
d8a4b6c735
Get everything to build again we have to merge soon.
2023-10-24 11:26:12 -04:00
Michael Chung
48ed6d118c
Merge issues with VSCode? this is strange ....
2023-10-24 11:15:31 -04:00
Michael Chung
4c3ac3edda
Merge branch 'master' into feature/enqueue_tts_request
2023-10-24 10:20:37 -04:00
Brandon Thomas
dae5764658
codegen queries
2023-10-24 05:40:33 -04:00
Brandon Thomas
98547df063
propagate avt from jobs to media_files
2023-10-24 05:12:42 -04:00
Brandon Thomas
9c856235fc
write avt cookie token to inference jobs
2023-10-24 05:04:00 -04:00
Brandon Thomas
205f6de1b2
fix lint failures
2023-10-24 04:20:38 -04:00
Brandon Thomas
a9fa45575e
additional comment
2023-10-24 04:07:02 -04:00
Brandon Thomas
1b77974a0e
change user token prefix
2023-10-24 04:06:33 -04:00
Brandon Thomas
724ae2570e
How did this ever work!?
2023-10-24 03:56:38 -04:00
Brandon Thomas
dc7b5b7e60
Merge pull request #120 from storytold/echelon-terminate-job-endpoint
...
endpoint to terminate jobs
2023-10-24 02:41:03 -04:00
Brandon Thomas
3259433717
endpoint to terminate jobs
2023-10-24 02:40:00 -04:00
Brandon Thomas
bc5d84a306
use the new job status enum
2023-10-24 01:22:48 -04:00
Brandon Thomas
2357f00944
Merge pull request #119 from storytold/echelon-job-system-new-states
...
Introduce two new job status types to generic inference jobs
2023-10-24 01:08:15 -04:00
Brandon Thomas
24127f20e4
Introduce two new job status types to generic inference jobs
2023-10-24 01:06:14 -04:00
Brandon Thomas
4c8f14d4d5
Migration to make password_resets.ip_address_redemption nullable
2023-10-23 22:11:26 -04:00
Brandon Thomas
e14440ba02
undo edit to previous migration (should be harmless in prod)
2023-10-23 22:05:11 -04:00
Michael Chung
7295a3295f
Fix prefixes for create and inference
2023-10-23 22:03:37 -04:00
Michael Chung
10176079c7
remove variables not used
2023-10-23 21:59:26 -04:00
Michael Chung
8999a80e92
Change root ml dir
2023-10-23 21:34:58 -04:00
Michael Chung
41b07049ff
Remove comments
2023-10-23 21:29:41 -04:00
Michael Chung
b45f6ed691
Restore storyteller rust root for dev_database_seed
2023-10-23 21:25:04 -04:00
Michael Chung
9d16eb05c1
Fix data seed env-secrets path.
2023-10-23 21:13:27 -04:00
Michael Chung
b414540251
Fixing issue with the origin model type along side tests.
2023-10-23 21:11:00 -04:00
Michael Chung
2949456adc
Restore bad merge on id_category.rs
2023-10-23 21:07:35 -04:00
dependabot[bot]
02d06df0e2
Bump actix-http from 3.3.0 to 3.4.0
...
Bumps [actix-http](https://github.com/actix/actix-web ) from 3.3.0 to 3.4.0.
- [Release notes](https://github.com/actix/actix-web/releases )
- [Changelog](https://github.com/actix/actix-web/blob/master/CHANGES.md )
- [Commits](https://github.com/actix/actix-web/compare/web-v3.3.0...http-v3.4.0 )
---
updated-dependencies:
- dependency-name: actix-http
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-23 22:31:41 +00:00
dependabot[bot]
b89ef1fe20
Bump pulldown-cmark from 0.8.0 to 0.9.3
...
Bumps [pulldown-cmark](https://github.com/raphlinus/pulldown-cmark ) from 0.8.0 to 0.9.3.
- [Release notes](https://github.com/raphlinus/pulldown-cmark/releases )
- [Commits](https://github.com/raphlinus/pulldown-cmark/compare/v0.8.0...v0.9.3 )
---
updated-dependencies:
- dependency-name: pulldown-cmark
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-23 22:30:59 +00:00
Michael Chung
3a72292898
Some minor comment fix
2023-10-23 16:54:27 -04:00
Michael Chung
07c640ce84
Retest the endpoints with the correct credentials
...
One more integration test with multiple wav files.
2023-10-23 16:52:31 -04:00
Michael Chung
49a15fd1f1
Cleaning up some of the end points.
2023-10-23 16:22:37 -04:00
Michael Chung
3267f9949d
Added ip address and creator token.
2023-10-23 16:02:07 -04:00
Michael Chung
47df6930d2
Basically works well!
...
Few things to checkout.
2023-10-22 23:38:31 -04:00
Michael Chung
913d282d60
Fixed extensions on create
...
Checking whether media uploads.
2023-10-22 20:52:57 -04:00
Michael Chung
743934ff50
Need to do a clean up then check media upload and table
2023-10-22 20:36:32 -04:00
Michael Chung
bc209fe939
So the prefix wasn't populated in the seed I think!
2023-10-22 17:57:35 -04:00
Michael Chung
302975ddfd
Seeded db testing again
2023-10-22 11:57:29 -04:00
Michael Chung
d7664e8e1c
Merge branch 'master' into feature/enqueue_tts_request
2023-10-21 02:41:43 -04:00
Michael Chung
9f7fc09e9f
Builds testing.
2023-10-21 01:13:39 -04:00
Michael Chung
2686cb94e0
Testing create command now.
2023-10-21 00:28:11 -04:00
Michael Chung
fd7f1e1893
testing now.
2023-10-20 23:27:31 -04:00
Brandon Thomas
eb3499596e
always output stderr
2023-10-20 14:45:03 -04:00
Michael Chung
00bfdad3d0
Test pass!
2023-10-20 12:13:57 -04:00
Michael Chung
ff3821956a
Builds again
2023-10-20 11:43:16 -04:00
Michael Chung
a5a5f5473b
Testing!
2023-10-20 10:13:23 -04:00
Brandon Thomas
7c553ffcee
fix rvc jobs
2023-10-20 07:00:09 -04:00
Brandon Thomas
52f0b44c26
codegen db
2023-10-20 06:14:49 -04:00
Brandon Thomas
fbed7cd530
Merge pull request #113 from storytold/echelon-voice-conversion-media-files
...
voice conversion --> media files
2023-10-20 06:14:19 -04:00
Brandon Thomas
4ce8752a6a
codegen db
2023-10-20 06:12:41 -04:00
Brandon Thomas
3239e318b1
fix inference job status links
2023-10-20 05:37:51 -04:00
Brandon Thomas
471dcff697
RVC -> media_files
2023-10-20 05:14:00 -04:00
Brandon Thomas
2af57fcf3e
Write voice conversion results to media_files tables
2023-10-20 05:14:00 -04:00
Brandon Thomas
f2b0e77210
fix stupid "1" bug on generic jobs
2023-10-20 05:13:44 -04:00
Michael Chung
10c8bc1ef3
Just need to run inference and pass the insert the record and upload the voice once it infers.
...
Run the path test.
2023-10-20 01:46:13 -04:00
Brandon Thomas
35dfe6a7f2
fix lints
2023-10-20 01:09:56 -04:00
Brandon Thomas
48ecc44978
Merge pull request #112 from storytold/echelon-seed-samples
...
Update seed tool to seed and upload samples
2023-10-19 22:36:30 -04:00
Brandon Thomas
4f0e2d5f72
Update seed tool to seed and upload samples
2023-10-19 22:33:24 -04:00
Brandon Thomas
96c99fd102
Merge pull request #111 from storytold/echelon-media-file-upload-cli
...
CLI tool to upload media files and save them to the DB
2023-10-19 21:56:38 -04:00
Brandon Thomas
26794b3d2e
CLI tool to upload media files and save them to the DB
2023-10-19 21:52:32 -04:00
Michael Chung
c3a60ed8ab
Merge branch 'master' into feature/enqueue_tts_request
2023-10-19 20:12:40 -04:00
Michael Chung
13964901f0
update process job created a fork for creating voice
2023-10-19 19:19:53 -04:00
Brandon Thomas
593fb50fcb
Merge pull request #110 from storytold/echelon-list-dataset-samples
...
Enrich list dataset samples query + endpoint with bucket information
2023-10-19 18:24:39 -04:00
Brandon Thomas
fff71d7aa4
Enrich list dataset samples query + endpoint with bucket information
2023-10-19 18:18:35 -04:00
Michael Chung
57eecb3757
Creating the create voice job
2023-10-19 16:26:43 -04:00
Brandon Thomas
022aa523cb
fix cookie paths ?
2023-10-19 05:56:15 -04:00
Brandon Thomas
6d01506bd1
fix cookie path
2023-10-19 05:53:44 -04:00
Brandon Thomas
0cc3baee27
Merge pull request #108 from storytold/brandon-set-avt-cookie
...
Start setting AVT cookie on /v1/session endpoint
2023-10-19 05:06:00 -04:00
Brandon Thomas
d5b28d2d3e
Start setting AVT cookie on /v1/session endpoint
2023-10-19 04:24:50 -04:00
Brandon Thomas
d6a3d4887f
Merge pull request #107 from storytold/bt-revert-sha2-upgrade
...
Revert "Bump sha2 from 0.9.5 to 0.10.5"
2023-10-19 02:44:56 -04:00
Brandon Thomas
cce4f5f3b7
Revert "Bump sha2 from 0.9.5 to 0.10.5"
...
This reverts commit 59f7b6f732 .
2023-10-19 02:44:21 -04:00
Brandon Thomas
9123dbc3d9
Merge pull request #98 from storytold/dependabot/cargo/sha2-0.10.5
...
Bump sha2 from 0.9.5 to 0.10.5
2023-10-19 02:41:04 -04:00
Brandon Thomas
d43a747033
Merge pull request #100 from storytold/dependabot/cargo/rpassword-7.2.0
...
Bump rpassword from 5.0.1 to 7.2.0
2023-10-19 02:40:25 -04:00
Brandon Thomas
c3e5b42bf3
use JwtSigner for session cookie
2023-10-19 02:39:17 -04:00
Michael Chung
25cdbf2f1d
Adding create voice command
2023-10-19 02:09:16 -04:00
dependabot[bot]
59f7b6f732
Bump sha2 from 0.9.5 to 0.10.5
...
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.9.5 to 0.10.5.
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.9.5...sha2-v0.10.5 )
---
updated-dependencies:
- dependency-name: sha2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-19 05:57:20 +00:00
dependabot[bot]
fe7251744f
Bump rpassword from 5.0.1 to 7.2.0
...
Bumps [rpassword](https://github.com/conradkleinespel/rpassword ) from 5.0.1 to 7.2.0.
- [Release notes](https://github.com/conradkleinespel/rpassword/releases )
- [Commits](https://github.com/conradkleinespel/rpassword/compare/v5.0.1...v7.2.0 )
---
updated-dependencies:
- dependency-name: rpassword
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-19 05:56:56 +00:00
Brandon Thomas
fdd60b436a
Merge pull request #99 from storytold/dependabot/cargo/scraper-0.17.1
...
Bump scraper from 0.14.0 to 0.17.1
2023-10-19 01:55:06 -04:00
Brandon Thomas
0836e88f4c
Merge pull request #101 from storytold/dependabot/cargo/diesel-2.1.3
...
Bump diesel from 1.4.6 to 2.1.3
2023-10-19 01:54:46 -04:00
Brandon Thomas
261978f763
Merge pull request #102 from storytold/dependabot/cargo/anyhow-1.0.75
...
Bump anyhow from 1.0.40 to 1.0.75
2023-10-19 01:53:55 -04:00
Brandon Thomas
d072e021d1
Merge pull request #106 from storytold/echelon-cookies
...
Cookie stuff - JWT signer, anonymous visitor cookies, etc.
2023-10-19 01:53:05 -04:00
Brandon Thomas
66442d9eda
Cookie stuff - JWT signer, anonymous visitor cookies, etc.
...
- JWT signer is reusable, tested
- AVT cookies improve the anonymous user experience and will help
internal analytics
2023-10-19 01:37:50 -04:00
Michael Chung
0f4cab9ca3
Added missing new file
2023-10-18 19:50:24 -04:00
Michael Chung
6de4d451ac
Fixed import issues
2023-10-18 19:50:07 -04:00
Michael Chung
9d4e426ace
It is now being tested then we work on the command side.
2023-10-18 18:02:30 -04:00
Michael Chung
bfb5103f46
Merge branch 'master' into feature/enqueue_tts_request
2023-10-18 13:37:23 -04:00
Michael Chung
3308c05836
Need to pull master
2023-10-18 13:26:19 -04:00
Brandon Thomas
5a539e589d
codegen db
2023-10-18 04:53:55 -04:00
Brandon Thomas
604c72179a
password_resets needs a unique index on (user, secret_key)
2023-10-18 02:22:39 -04:00
Michael Chung
be19eefa1a
Upload and create record and were good to do the other command and clean up.
2023-10-18 02:13:59 -04:00
Michael Chung
34e2b1e544
It works runs inference_job
...
Need to upload the file then create the record for download
2023-10-18 02:03:41 -04:00
Brandon Thomas
95152e9a88
fix replacement paths
2023-10-18 00:31:43 -04:00
Michael Chung
cbe8aaa1ba
More fixes
2023-10-18 00:04:33 -04:00
Michael Chung
11185584a7
Fixing typos and virtual env
2023-10-17 22:56:30 -04:00
Michael Chung
76559cf783
fix the env
2023-10-17 22:11:22 -04:00
Michael Chung
2e7bd622f3
fixed a typo
2023-10-17 22:06:42 -04:00
Michael Chung
68048659d4
Testing inference_job
2023-10-17 22:00:14 -04:00
Brandon Thomas
608e94a6a8
Merge pull request #105 from storytold/echelon-config-path-substitution
...
Substitute config absolute paths with magic substitution strings
2023-10-17 21:38:06 -04:00
Brandon Thomas
9e0bee8fba
Substitute config absolute paths with magic substitution strings
2023-10-17 21:37:20 -04:00
Brandon Thomas
dcec9b9e8a
Merge pull request #104 from storytold/echelon-storyteller-home
...
"storyteller root" directory in development
2023-10-17 21:12:51 -04:00
Brandon Thomas
3fc0f45942
"storyteller root" directory in development
2023-10-17 21:04:54 -04:00
Brandon Thomas
bfd325900f
Merge pull request #103 from storytold/echelon-better-envvars
...
Better env var support
2023-10-17 17:00:54 -04:00
Brandon Thomas
1ef7ae1009
Better env var support
2023-10-17 16:31:53 -04:00
Michael Chung
17d51f8d87
Merge branch 'master' into feature/enqueue_tts_request
2023-10-17 13:37:35 -04:00
Brandon Thomas
ca81d1b543
fix build / lint errors
2023-10-16 20:02:41 -04:00
dependabot[bot]
1de3e669d6
Bump anyhow from 1.0.40 to 1.0.75
...
Bumps [anyhow](https://github.com/dtolnay/anyhow ) from 1.0.40 to 1.0.75.
- [Release notes](https://github.com/dtolnay/anyhow/releases )
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.40...1.0.75 )
---
updated-dependencies:
- dependency-name: anyhow
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-16 22:18:42 +00:00
dependabot[bot]
ac39ac0a76
Bump diesel from 1.4.6 to 2.1.3
...
Bumps [diesel](https://github.com/diesel-rs/diesel ) from 1.4.6 to 2.1.3.
- [Release notes](https://github.com/diesel-rs/diesel/releases )
- [Changelog](https://github.com/diesel-rs/diesel/blob/v2.1.3/CHANGELOG.md )
- [Commits](https://github.com/diesel-rs/diesel/compare/v1.4.6...v2.1.3 )
---
updated-dependencies:
- dependency-name: diesel
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-16 22:18:25 +00:00
dependabot[bot]
f9caa7d836
Bump scraper from 0.14.0 to 0.17.1
...
Bumps [scraper](https://github.com/causal-agent/scraper ) from 0.14.0 to 0.17.1.
- [Release notes](https://github.com/causal-agent/scraper/releases )
- [Commits](https://github.com/causal-agent/scraper/compare/v0.14.0...v0.17.1 )
---
updated-dependencies:
- dependency-name: scraper
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-16 22:17:50 +00:00
Michael Chung
5f7a10a54c
Merge branch 'master' into feature/enqueue_tts_request
2023-10-16 09:34:46 -04:00
Brandon Thomas
e478c73ddf
Merge pull request #97 from storytold/echelon-sample-upload
...
Dataset sample upload (not yet tested, but compiles, and needs lots of cleanup)
2023-10-14 12:23:36 -04:00
Brandon Thomas
92676e842c
Dataset sample upload
2023-10-14 12:18:42 -04:00
Michael Chung
7eee225296
Builds again need to clearify what happened to the download function
2023-10-13 15:36:21 -04:00
Michael Chung
1319471c04
Merge branch 'master' into feature/enqueue_tts_request
2023-10-13 10:02:17 -04:00
Brandon Thomas
47e7269880
codegen db
2023-10-13 02:50:15 -04:00
Brandon Thomas
9b83caece1
Merge pull request #96 from storytold/echelon-get-media-file-endpoint
...
v1 of media_file GET endpoint.
2023-10-13 02:40:39 -04:00
Brandon Thomas
138057e105
v1 of media_file GET endpoint.
...
Media files are used for inference outputs, file uploads, Zero Shot
files, etc. We don't have any of the basic CRUD operations around them
yet, so this is a start.
This endpoint will need more metadata - moderation, file provenance,
file details, etc. But this will do for now.
2023-10-13 02:38:34 -04:00
Brandon Thomas
3e8b6f39fe
Merge branch 'master' into feature/enqueue_tts_request
2023-10-12 23:28:08 -04:00
Brandon Thomas
63b4a3180f
filter out sadtalker name
2023-10-12 06:22:39 -04:00
Brandon Thomas
6842794af6
another face detection failure
2023-10-12 06:15:43 -04:00
Brandon Thomas
a963e5146a
more instances of face detection failure
2023-10-12 05:33:56 -04:00
Brandon Thomas
eb65ed5fa8
re-codegen db
2023-10-12 03:52:12 -04:00
Brandon Thomas
f6989230be
write origin_product_category
2023-10-12 03:51:01 -04:00
Brandon Thomas
2d3f29139a
re-codegen db
2023-10-12 02:53:48 -04:00
Brandon Thomas
a059aa7271
fix lints
2023-10-12 02:08:13 -04:00
Brandon Thomas
8699a9e342
record and report frontend_failure_category
2023-10-12 02:04:29 -04:00
Brandon Thomas
48bf168d99
improve readability
2023-10-12 01:14:03 -04:00
Brandon Thomas
f1fd99be15
record frontend_failure_category, emit SadTalker errors
2023-10-12 01:03:36 -04:00
Michael Chung
a0b8849806
Trying to build again.
2023-10-12 00:56:50 -04:00
Brandon Thomas
49db299f96
enums for two new columns
2023-10-11 23:09:18 -04:00
Brandon Thomas
b1e87b7d90
two migrations (media_files, generic_inference_jobs)
...
- media_files.origin_product_category
- generic_inference_jobs.frontend_failure_category
2023-10-11 22:38:23 -04:00
Michael Chung
bb0a4958ef
Need to build and fix the container.
2023-10-11 18:19:40 -04:00
Brandon Thomas
4aacc23101
kill sadtalker jobs
2023-10-11 17:31:41 -04:00
Brandon Thomas
536307c162
analytics queries
2023-10-11 17:11:34 -04:00
Brandon Thomas
d5c86d1345
fix breakage due to s3 client upgrade (YOLO) + lint fixes
2023-10-11 16:53:37 -04:00
Brandon Thomas
1900a31541
Merge pull request #66 from storytold/dependabot/cargo/rust-s3-0.33.0
...
Bump rust-s3 from 0.32.3 to 0.33.0
2023-10-11 16:26:24 -04:00
Brandon Thomas
067538f1c2
Merge pull request #88 from storytold/oct-10-mithoo
...
use usernames to list datasets/voices & simple handler for listing samples
2023-10-11 16:19:21 -04:00
Michael Chung
a256681f6d
Merge branch 'master' into feature/enqueue_tts_request
2023-10-11 12:58:57 -04:00
kasisnu
03443be19c
inventory list voices with pagination
2023-10-11 16:52:37 +05:30
Michael Chung
ec03420efc
Fixed issue with typo in job.
...
Need to fix process job and run it.
2023-10-11 02:51:47 -04:00
Brandon Thomas
bfc8171fa7
additional safeguards
2023-10-11 00:02:36 -04:00
Brandon Thomas
248ee45d11
multithreaded
2023-10-10 23:49:43 -04:00
Brandon Thomas
97be5da1b5
Truncate bucket hash for seeded zero shot voice records
2023-10-10 22:06:16 -04:00
Brandon Thomas
d26902911f
Merge pull request #93 from storytold/feature/fix-database-seed-voice-embeddings
...
Fixed bucket hash issue
2023-10-10 22:00:27 -04:00
Michael Chung
0560a2d607
Fixed bucket hash issue
2023-10-10 20:34:27 -04:00
Michael Chung
264058ea87
Just a quick commit gotta modify the seeding script to get the bucket hashes for downloading
2023-10-10 20:20:56 -04:00
Brandon Thomas
b175cc0e65
cleanup more statuses
2023-10-10 19:24:07 -04:00
Brandon Thomas
ae781a3e37
rename to kubectl- to not collide with base tool in tab complete
2023-10-10 19:15:53 -04:00
Brandon Thomas
ee00fbe585
cleanup pods with these statuses
2023-10-10 19:12:39 -04:00
Brandon Thomas
82791ec39e
delete pods randomly
2023-10-10 18:51:35 -04:00
Brandon Thomas
b6bbc76b18
delete batches
2023-10-10 18:24:57 -04:00
Brandon Thomas
1742827ed9
ergonomics
2023-10-10 18:01:06 -04:00
Brandon Thomas
68bc9d0bb0
Merge pull request #89 from storytold/echelon-kubectl-cli
...
kubectl cli to cleanup dead pods
2023-10-10 17:51:12 -04:00
Brandon Thomas
ccc67d43cc
kubectl cli to cleanup dead pods
2023-10-10 17:50:05 -04:00
Michael Chung
3845c632b2
Turns out we don't support folder downloads only files.
2023-10-10 17:40:33 -04:00
Michael Chung
22518d9164
Fixed pathing typos
2023-10-10 16:24:16 -04:00
Michael Chung
5dbed7afbb
Fixed typo on downloading the vall-e-x model
2023-10-10 16:18:35 -04:00
Michael Chung
a485666b1c
Test pass!
...
Payload delivered and picked up.
Need to ensure the job now runs locally.
2023-10-10 16:03:27 -04:00
Michael Chung
54e9b8af70
Fixed routing issue with the job need to move tts text to maybe tts text out of the json.
2023-10-10 15:32:51 -04:00
kasisnu
5a7b0b1bdd
simple list dataset samples
2023-10-10 19:15:58 +05:30
kasisnu
ee0067161e
use usernames instead of user tokens to list voices/datasets
2023-10-10 18:03:22 +05:30
Brandon Thomas
a0f464e454
Merge pull request #87 from storytold/echelon-dataset-endpoints
...
Dataset endpoints, refactoring, cleanup, etc.
2023-10-10 03:22:21 -04:00
Brandon Thomas
332982faa5
Dataset endpoints, refactoring, cleanup, etc.
2023-10-10 03:16:11 -04:00
Brandon Thomas
c0e142d668
RMVPE support
2023-10-10 01:18:12 -04:00
Brandon Thomas
ca8dce4805
re-codegen db
2023-10-09 23:58:09 -04:00
Brandon Thomas
ed1eb9a540
stop dependabot from suggesting /old_code fixes (maybe delete all this?)
2023-10-09 23:30:16 -04:00
Brandon Thomas
0620fa6f98
extra tests for previously broken upgrade
2023-10-09 23:15:09 -04:00
Brandon Thomas
94adc01d62
Merge pull request #86 from storytold/echelon-cleanup-identifiers
...
Cleanup identifiers (tokens package)
2023-10-09 23:02:15 -04:00
Brandon Thomas
6e76cd3da6
Cleanup identifiers (tokens package)
2023-10-09 23:00:11 -04:00
Brandon Thomas
5a1fd2679c
fix for broken dependabot base64 upgrade (semvar violation)
2023-10-09 22:25:38 -04:00
dependabot[bot]
f5c3e12f90
Bump rust-s3 from 0.32.3 to 0.33.0
...
Bumps [rust-s3](https://github.com/durch/rust-s3 ) from 0.32.3 to 0.33.0.
- [Release notes](https://github.com/durch/rust-s3/releases )
- [Commits](https://github.com/durch/rust-s3/commits/v0.33.0 )
---
updated-dependencies:
- dependency-name: rust-s3
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-10 02:02:36 +00:00
Brandon Thomas
0a141ea118
Merge pull request #84 from storytold/dependabot/cargo/cidr-utils-0.5.11
...
Bump cidr-utils from 0.5.10 to 0.5.11
2023-10-09 22:01:02 -04:00
Brandon Thomas
dd6c5d1975
Merge pull request #82 from storytold/dependabot/cargo/base64-0.21.0
...
Bump base64 from 0.13.0 to 0.21.0
2023-10-09 22:00:40 -04:00
Brandon Thomas
91dcd1f876
Merge pull request #83 from storytold/dependabot/cargo/unicode-segmentation-1.10.1
...
Bump unicode-segmentation from 1.7.1 to 1.10.1
2023-10-09 22:00:08 -04:00
Brandon Thomas
1869ead6ad
Merge pull request #85 from storytold/dependabot/cargo/futures-util-0.3.28
...
Bump futures-util from 0.3.26 to 0.3.28
2023-10-09 21:59:34 -04:00
Brandon Thomas
1c81874b28
fix tests and lints
2023-10-09 21:55:48 -04:00
Brandon Thomas
c8b79bfb40
cleanup logic
2023-10-09 21:44:14 -04:00
Brandon Thomas
767d76f831
comments about dev bucket
2023-10-09 21:04:36 -04:00
Brandon Thomas
b163791db2
Merge pull request #77 from storytold/feature/enqueue_tts_request
...
Feature/enqueue tts request
2023-10-09 21:02:26 -04:00
Brandon Thomas
d4e8bfb1f8
Merge pull request #79 from storytold/oct-06-mithoo
...
adds list dataset handler and update/delete voices handler
2023-10-09 20:58:25 -04:00
dependabot[bot]
fabc1583ca
Bump futures-util from 0.3.26 to 0.3.28
...
Bumps [futures-util](https://github.com/rust-lang/futures-rs ) from 0.3.26 to 0.3.28.
- [Release notes](https://github.com/rust-lang/futures-rs/releases )
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.26...0.3.28 )
---
updated-dependencies:
- dependency-name: futures-util
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:08:03 +00:00
dependabot[bot]
804ab3e4e8
Bump cidr-utils from 0.5.10 to 0.5.11
...
Bumps [cidr-utils](https://github.com/magiclen/cidr-utils ) from 0.5.10 to 0.5.11.
- [Commits](https://github.com/magiclen/cidr-utils/compare/v0.5.10...v0.5.11 )
---
updated-dependencies:
- dependency-name: cidr-utils
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:07:31 +00:00
dependabot[bot]
cd0e104808
Bump unicode-segmentation from 1.7.1 to 1.10.1
...
Bumps [unicode-segmentation](https://github.com/unicode-rs/unicode-segmentation ) from 1.7.1 to 1.10.1.
- [Commits](https://github.com/unicode-rs/unicode-segmentation/compare/1.7.1...v1.10.1 )
---
updated-dependencies:
- dependency-name: unicode-segmentation
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:07:00 +00:00
dependabot[bot]
a7d794e29b
Bump base64 from 0.13.0 to 0.21.0
...
Bumps [base64](https://github.com/marshallpierce/rust-base64 ) from 0.13.0 to 0.21.0.
- [Changelog](https://github.com/marshallpierce/rust-base64/blob/master/RELEASE-NOTES.md )
- [Commits](https://github.com/marshallpierce/rust-base64/compare/v0.13.0...v0.21.0 )
---
updated-dependencies:
- dependency-name: base64
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-09 23:05:57 +00:00
kasisnu
eed7dc28f8
adds simple voice list endpoint
2023-10-09 18:33:07 +05:30
kasisnu
d4c5710513
filter private/hidden datasets, make user token non-optional
2023-10-09 12:26:54 +05:30
Michael Chung
d8c4df4c02
Ok fixed the odd linting error.
2023-10-06 18:12:04 -04:00
Michael Chung
13809ad309
Fixed issue
2023-10-06 18:04:46 -04:00
Michael Chung
95888e683d
Formatter works now, braces can get properly placed
2023-10-06 18:01:25 -04:00
Michael Chung
3012dea984
process_single_tts_job augmented...
2023-10-06 17:58:07 -04:00
Michael Chung
ae899d8aca
Fixed most of the job and implemented it.
...
Need to run the container this might be fun haha ...
2023-10-06 15:21:38 -04:00
Michael Chung
dda05ba22c
Have to pull master for the lastest seed changes
2023-10-06 13:01:17 -04:00
Brandon Thomas
63795b2cb6
Merge pull request #81 from storytold/echelon-test-weights
...
Add zero shot weights and upload six test files; add to db seed tool
2023-10-06 12:51:20 -04:00
Brandon Thomas
8aa97a6a4f
Add zero shot weights and upload six test files; add to db seed tool
2023-10-06 12:50:02 -04:00
Michael Chung
e23369761b
Merge branch 'master' into feature/enqueue_tts_request
2023-10-06 11:35:11 -04:00
Brandon Thomas
2b27d6fe41
Merge pull request #80 from storytold/echelon-seed-tool-2
...
More seed tool things
2023-10-06 11:30:14 -04:00
Michael Chung
c6eefc41ec
Ok fixed the build now working on job running.
2023-10-06 10:55:51 -04:00
Michael Chung
9e3a3b79f9
job process wip
2023-10-06 09:49:09 -04:00
kasisnu
2aa063c354
some meat on the list datasets handler - filtering logic needs wdork
2023-10-06 18:04:44 +05:30
kasisnu
f77d4a636b
skip mod token when creating datasets
2023-10-06 16:07:29 +05:30
Brandon Thomas
018b05a3a2
Seed voice conversion models
2023-10-06 02:50:12 -04:00
kasisnu
fd3661e25d
list/delete voices simple handlers
2023-10-06 12:07:51 +05:30
Brandon Thomas
39de5aba13
More updates to seed tool
2023-10-06 01:30:43 -04:00
Brandon Thomas
6354e7c3b4
Merge pull request #78 from storytold/echelon-db-seeding
...
Database seed tool
2023-10-06 01:17:59 -04:00
Brandon Thomas
eaa9ddd62d
seed voice
2023-10-06 00:51:52 -04:00
Michael Chung
195a2eeb9c
Outlined the things needed to be done in process_job
2023-10-06 00:49:42 -04:00
Brandon Thomas
bef5dce947
seed dataset
2023-10-06 00:36:15 -04:00
Brandon Thomas
dd3f9c9d3e
move query modules
2023-10-06 00:19:41 -04:00
Brandon Thomas
aac31f77ad
Database seed tool
2023-10-06 00:09:42 -04:00
Brandon Thomas
d07a147db9
Merge pull request #62 from storytold/feat-create-dataset
...
create zs dataset endpoint - basic impl
2023-10-06 00:03:47 -04:00
Michael Chung
ba76acec35
some more fixes to model downloaders
2023-10-05 23:05:27 -04:00
Michael Chung
a2c196587f
Added Inference Command Stub
...
Added Create Embedding Command Stub
Need to implement job process:
Download Embedding File aka voice token.
model_downloaders is all good.
validate_job.
2023-10-05 22:29:25 -04:00
Brandon Thomas
8d36d6c709
Add some downloaders for vall-e-x
2023-10-05 21:43:36 -04:00
Michael Chung
4f5f6cfe51
Getting the pieces ready for inference_job
2023-10-05 13:29:51 -04:00
kasisnu
7c59f267fc
placeholder sql query to create a voice
2023-10-05 17:41:44 +05:30
kasisnu
23a6daa144
list handler questions
2023-10-05 16:34:36 +05:30
kasisnu
a22038ea31
delete datasets & allow mods to undelete
2023-10-05 15:59:56 +05:30
Michael Chung
5de40b2dab
Fix a build issues the payload sends exploring the job creation and inference side of it.
2023-10-04 16:30:46 -04:00
kasisnu
484e6788e3
enforce user token check
2023-10-04 19:02:16 +05:30
kasisnu
b67cfb5fbe
basic update dataset handler & synthetic id tracking
2023-10-04 18:03:13 +05:30
Brandon Thomas
d46075a2a3
codegen
2023-10-04 03:58:05 -04:00
Brandon Thomas
aa9b834f4b
Merge pull request #76 from storytold/echelon-add-media-file-extension
...
Add media prefix and file extension
2023-10-04 03:50:00 -04:00
Brandon Thomas
2abba4b639
populate prefix and extension
2023-10-04 03:34:43 -04:00
kasisnu
c42c091b2d
create zs dataset endpoint - basic impl
2023-10-04 12:32:58 +05:30
Brandon Thomas
cde8447a9c
add table for bucket prefix
2023-10-04 02:33:28 -04:00
Brandon Thomas
4306a4763d
Add extension
2023-10-04 02:24:28 -04:00
Brandon Thomas
9701e29b58
Migration to add file extension (eg. ".mp4")
2023-10-04 02:24:28 -04:00
Brandon Thomas
8512846efa
Merge pull request #75 from storytold/bt-revert-sqlx-upgrade
...
Revert "Bump sqlx-core from 0.6.2 to 0.7.2"
2023-10-04 02:23:09 -04:00
Brandon Thomas
c7b54e1548
Revert "Bump sqlx-core from 0.6.2 to 0.7.2"
...
This reverts commit 6b8c1a3106 .
2023-10-04 02:15:54 -04:00
Brandon Thomas
8343cf1b65
Merge pull request #70 from storytold/dependabot/cargo/sqlx-core-0.7.2
...
Bump sqlx-core from 0.6.2 to 0.7.2
2023-10-04 02:04:06 -04:00
Brandon Thomas
4d4b55d39d
Merge pull request #68 from storytold/dependabot/cargo/once_cell-1.18.0
...
Bump once_cell from 1.17.0 to 1.18.0
2023-10-04 02:03:54 -04:00
dependabot[bot]
6b8c1a3106
Bump sqlx-core from 0.6.2 to 0.7.2
...
Bumps [sqlx-core](https://github.com/launchbadge/sqlx ) from 0.6.2 to 0.7.2.
- [Changelog](https://github.com/launchbadge/sqlx/blob/main/CHANGELOG.md )
- [Commits](https://github.com/launchbadge/sqlx/commits )
---
updated-dependencies:
- dependency-name: sqlx-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 06:03:43 +00:00
Brandon Thomas
63b3cb8216
Merge pull request #67 from storytold/dependabot/cargo/url-2.4.1
...
Bump url from 2.3.1 to 2.4.1
2023-10-04 02:03:25 -04:00
Brandon Thomas
3d4522126e
Merge pull request #65 from storytold/dependabot/cargo/openssl-0.10.57
...
Bump openssl from 0.10.42 to 0.10.57
2023-10-04 02:02:33 -04:00
Brandon Thomas
8be1b5afa3
Merge pull request #69 from storytold/dependabot/cargo/actix-rt-2.9.0
...
Bump actix-rt from 2.7.0 to 2.9.0
2023-10-04 02:02:15 -04:00
dependabot[bot]
11f6995942
Bump actix-rt from 2.7.0 to 2.9.0
...
Bumps [actix-rt](https://github.com/actix/actix-net ) from 2.7.0 to 2.9.0.
- [Release notes](https://github.com/actix/actix-net/releases )
- [Commits](https://github.com/actix/actix-net/compare/rt-v2.7.0...rt-v2.9.0 )
---
updated-dependencies:
- dependency-name: actix-rt
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:56:36 +00:00
dependabot[bot]
589d13fdd1
Bump once_cell from 1.17.0 to 1.18.0
...
Bumps [once_cell](https://github.com/matklad/once_cell ) from 1.17.0 to 1.18.0.
- [Changelog](https://github.com/matklad/once_cell/blob/master/CHANGELOG.md )
- [Commits](https://github.com/matklad/once_cell/compare/v1.17.0...v1.18.0 )
---
updated-dependencies:
- dependency-name: once_cell
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:56:02 +00:00
dependabot[bot]
3f9160701f
Bump url from 2.3.1 to 2.4.1
...
Bumps [url](https://github.com/servo/rust-url ) from 2.3.1 to 2.4.1.
- [Release notes](https://github.com/servo/rust-url/releases )
- [Commits](https://github.com/servo/rust-url/compare/v2.3.1...v2.4.1 )
---
updated-dependencies:
- dependency-name: url
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:55:30 +00:00
Brandon Thomas
9e8c27edfd
Create dependabot.yml
2023-10-04 01:53:23 -04:00
dependabot[bot]
6540aed9dc
Bump openssl from 0.10.42 to 0.10.57
...
Bumps [openssl](https://github.com/sfackler/rust-openssl ) from 0.10.42 to 0.10.57.
- [Release notes](https://github.com/sfackler/rust-openssl/releases )
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.42...openssl-v0.10.57 )
---
updated-dependencies:
- dependency-name: openssl
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-10-04 05:53:08 +00:00
Brandon Thomas
7cd570083c
Merge pull request #64 from storytold/bt-misc-fix
...
fixing a few things
2023-10-04 01:10:15 -04:00
Brandon Thomas
8787e3ef1e
tests for lipsync payload
2023-10-04 01:09:40 -04:00
Brandon Thomas
49b25cc79d
fix query cache codegen
2023-10-04 01:09:40 -04:00
Brandon Thomas
eff73a9cff
actually check premium plan
2023-10-04 01:09:40 -04:00
Brandon Thomas
d0e3e0f6bb
Merge pull request #63 from storytold/bt-twitter-dimensions
...
SadTalker: Final API shape. Twitter dimensions, non-default options are opt-in, premium watermark
2023-10-04 00:31:00 -04:00
Brandon Thomas
e676df0bf4
premium plan features
2023-10-04 00:26:52 -04:00
Brandon Thomas
ebed726768
Resize SadTalker to "twitter" dimensions
2023-10-04 00:26:52 -04:00
Michael Chung
e0145f0e70
Test this endpoint ensure that the record is created and you can see it grabbed.
2023-10-03 19:09:09 -04:00
Brandon Thomas
2f3037514f
takedown requests
2023-10-03 13:38:13 -04:00
Michael Chung
f7c636cf58
Added TTS payloads should be able to enter a entry after a migration then follow the event
...
to the inference dispatch and fill out the code there.
2023-10-02 23:56:52 -04:00
Michael Chung
ec4a172929
Adding generic inference args and creating the job soon
2023-10-02 23:08:28 -04:00
Michael Chung
773b96fb35
Stubbing out work in the handler
...
Adding VallEX as a inference model type
Test pass
2023-10-02 21:45:40 -04:00
Michael Chung
40d0d0d844
Changing up enqueue_infer_tts_handler to allow embedding tokens.
2023-10-02 20:17:36 -04:00
Brandon Thomas
dbae9803e2
Merge pull request #61 from storytold/testing-and-images-libs
...
Libraries for testing and image processing
2023-10-02 16:21:28 -04:00
Brandon Thomas
87093bf291
Libraries for testing and image processing
...
Just getting started here.
2023-10-02 16:20:07 -04:00
Michael Chung
0b3ea3af2a
Working on enqueue_tts_request assuming the prompt is around.
2023-10-02 16:15:25 -04:00
ArEnSc
1a75d5b7b3
Merge pull request #60 from storytold/feature/postman-collections
...
Postman Collections
2023-10-02 14:58:16 -04:00
Michael Chung
fb5dbae029
Added the GPT4Prompt for generating the collections and posted some relevant end points.
2023-10-02 13:41:06 -04:00
Brandon Thomas
d2fba4349d
fix broken lint
2023-10-01 17:17:43 -04:00
Brandon Thomas
b76b4460e3
forgot to codegen after leaderboard query adjustment
2023-10-01 17:10:49 -04:00
Brandon Thomas
5fee53d7c7
Merge pull request #59 from storytold/echelon-sadtalker-options
...
More options for SadTalker
2023-10-01 17:07:33 -04:00
ArEnSc
4f589cd1b7
Merge pull request #58 from storytold/feature/Zeroshot-inference-job1
...
Feature/Stubs for Voice Designer?
2023-10-01 16:53:35 -04:00
Michael Chung
5b9f1551ee
Put stubs behind feature flag.
2023-10-01 16:51:14 -04:00
Michael Chung
e47125f12d
Nested the endpoints wrong because to many ))) and got confused.
2023-10-01 15:04:01 -04:00
Michael Chung
afa050b45e
Testing routes
2023-10-01 13:44:22 -04:00
Brandon Thomas
ab6986e4b4
Merge pull request #57 from storytold/echelon-hide-leaderboard
...
Hide Vegito's test account from TTS leaderboard
2023-10-01 05:45:20 -04:00
Brandon Thomas
53626cb312
More options for SadTalker
2023-10-01 05:07:56 -04:00
Brandon Thomas
a8810a2db8
Hide Vegito's account from TTS leaderboard
2023-09-30 11:07:08 -04:00
Michael Chung
cb8266d61e
Run then test end points for the responses
2023-09-30 01:43:56 -04:00
Michael Chung
056065458f
Early stubs
2023-09-30 01:43:25 -04:00
Michael Chung
7cb18d63f2
Initial stubs for the api
2023-09-30 01:27:36 -04:00
Michael Chung
12a119cc1b
Routing for the backend start
2023-09-29 20:30:09 -04:00
Brandon Thomas
c8d8546c57
Merge pull request #56 from storytold/echelon-zero-shot-tables
...
Zero shot tables
2023-09-29 00:10:16 -04:00
Brandon Thomas
3265e097c0
Zero shot tables
2023-09-28 23:45:31 -04:00
Brandon Thomas
695d3da34b
analytics query
2023-09-28 10:22:38 -04:00
Brandon Thomas
6733a19315
Merge pull request #55 from storytold/echelon-face-detection-early-failure
...
Do not respawn SadTalker jobs when face detection fails
2023-09-28 10:20:23 -04:00
Brandon Thomas
baefb9f7d6
Do not respawn SadTalker jobs when face detection fails
...
Currently SadTalker jobs will retry on failure, which is great for
worker nodes with transient issues. Unfortunately failure to detect a
face is a common user input error occuring in just around half of all
image uploads. This will permanently tombstone these jobs.
The new failure class can be reused for future animation systems that
rely on face detection.
There is still some minor work to do to surface this error to the
frontend / user in a friendly way.
2023-09-28 10:14:16 -04:00
Brandon Thomas
fc47232e6b
Update general_setup.md
2023-09-27 17:27:55 -04:00
Brandon Thomas
83dc262249
make lints and tests pass again
2023-09-26 02:13:16 -04:00
Brandon Thomas
1d3885c367
vendor in easyenv.rs (a crate I wrote)
2023-09-26 02:03:25 -04:00
Brandon Thomas
070433b416
Add watermarking capability
2023-09-22 11:49:55 -04:00
Brandon Thomas
f15b89cf3d
add face animation statistic to queue stats endpoint
2023-09-22 09:19:13 -04:00
Brandon Thomas
699bb6a6a7
Clion auto-optimize imports, remove dead imports, Clippy lint
2023-09-20 01:39:58 -04:00
Brandon Thomas
226f111a00
fix tests, lints
2023-09-20 01:07:26 -04:00
Brandon Thomas
b7794ab48f
ignore test data
2023-09-20 00:13:06 -04:00
Brandon Thomas
0bd5c9e93b
ignore c sources
2023-09-20 00:11:02 -04:00
ArEnSc
5a981f55aa
Merge pull request #54 from storytold/feature/General-Setup-Update
...
Feature/general setup update
2023-09-19 22:33:49 -04:00
michael chung
3e9581a29d
Minor update
2023-09-19 22:32:09 -04:00
michael chung
ab42870ff1
Updated General Setup!
2023-09-19 22:29:53 -04:00
michael chung
998c8ef49d
General Setup Guide Updates!
2023-09-19 22:09:29 -04:00
Brandon Thomas
aa8e7597ee
get rid of redundancy
2023-09-19 20:26:35 -04:00
Brandon Thomas
725d16bbd9
readme: hosts file, running application
2023-09-19 20:13:22 -04:00
Brandon Thomas
f6ee06a72f
updated setup README
2023-09-19 20:01:38 -04:00
Brandon Thomas
14d028ea8a
docs
2023-09-19 18:34:39 -04:00
Brandon Thomas
699c49c02f
cleanup docs
2023-09-19 18:31:00 -04:00
Brandon Thomas
b126998ee3
these are probably obsolete
2023-09-19 18:07:30 -04:00
Brandon Thomas
1b43433b72
Documentation updates
2023-09-19 18:06:37 -04:00
Brandon Thomas
1f7dc268a8
SadTalker arguments (wip)
2023-09-19 17:27:34 -04:00
Brandon Thomas
dda67adc52
optional alternate checkpoint path arg
2023-09-15 10:07:33 -04:00
Brandon Thomas
fa74b9715f
logging for job
2023-09-15 09:28:41 -04:00
Brandon Thomas
653a0b26ce
sleep(50) - ugh
2023-09-15 08:51:44 -04:00
Brandon Thomas
ab8e9b9134
sqlite was failing, emit which is being prepared
2023-09-15 06:36:11 -04:00
Brandon Thomas
dac67ada23
codegen db
2023-09-15 06:35:04 -04:00
Brandon Thomas
f56530e36b
Merge pull request #53 from storytold/bt-sadtalker-backup-2.2
...
Sad Talker worker, file uploads, etc.
2023-09-15 06:32:45 -04:00
Brandon Thomas
3077359165
logs
2023-09-15 06:29:22 -04:00
Brandon Thomas
efdb0377f4
serve bucket paths
2023-09-15 06:15:11 -04:00
Brandon Thomas
4e935a1c2b
worker details
2023-09-15 04:43:23 -04:00
Brandon Thomas
063760663f
get job working again
2023-09-15 04:14:38 -04:00
Brandon Thomas
176cbcc4be
remove directory full path, work on query
2023-09-15 03:33:55 -04:00
Brandon Thomas
359b7a5bd0
migrations, about to insert media file result
2023-09-15 02:19:41 -04:00
Brandon Thomas
9f67a3b82d
SadTalker inference works !
2023-09-14 05:33:08 -04:00
Brandon Thomas
eb0e05f61e
download image and audio
2023-09-14 04:58:28 -04:00
Brandon Thomas
24f6b3c2f6
upload image route
2023-09-12 20:04:58 -04:00
Brandon Thomas
c47bae40d4
download voice conversion result
2023-09-12 20:04:58 -04:00
Brandon Thomas
cf2c246bc2
voice_conversion_for_inference
2023-09-12 20:04:58 -04:00
Brandon Thomas
9b89402549
get_voice_conversion_result query
2023-09-12 20:04:58 -04:00
Brandon Thomas
f2f2bd465c
wip
2023-09-12 20:04:58 -04:00
Brandon Thomas
7e9acc6476
unpack args
2023-09-12 20:04:58 -04:00
Brandon Thomas
7d68347f4f
fixed enqueue, fixed downloaders
2023-09-12 20:04:58 -04:00
Brandon Thomas
655f9fad7d
downloaders
2023-09-12 20:04:58 -04:00
Brandon Thomas
754581ec70
impl_model_downloader appears to work
2023-09-12 20:04:58 -04:00
Brandon Thomas
80b7352581
async trait/macro starting to work
2023-09-12 20:04:58 -04:00
Brandon Thomas
dd7bd71587
model downloader trait wip
2023-09-12 20:04:58 -04:00
Brandon Thomas
e41f72305b
(from other laptop) - inference args work, inference-job boilerplate
2023-09-12 20:04:58 -04:00
Brandon Thomas
fa2a15a4f2
install route
2023-09-12 20:04:58 -04:00
Brandon Thomas
eddb71d712
enqueue animation endpoint + more plumbing
2023-09-12 20:04:58 -04:00
Brandon Thomas
71758e6616
upload images (untested)
2023-09-12 20:04:58 -04:00
Brandon Thomas
7afa50ce29
another 101soundboards account
2023-09-12 18:42:38 -04:00
Brandon Thomas
14480e50b4
analytics queries
2023-08-31 22:45:43 -04:00
Brandon Thomas
b99e4c5edb
more 101soundboards accounts and notes
2023-08-31 22:31:38 -04:00
Brandon Thomas
f5b7ad0428
analytics queries
2023-08-30 22:49:55 -04:00
Brandon Thomas
ff2713358d
imyfone notes
2023-08-28 21:37:28 -04:00
Brandon Thomas
60ab3565bd
101soundboards notes
2023-08-28 21:34:53 -04:00
Brandon Thomas
d4ee7a8673
ban some abusers
2023-08-28 21:31:49 -04:00
Brandon Thomas
8e15e1e14c
media_files enums
2023-08-23 21:33:06 -04:00
Brandon Thomas
a8f0947352
media file token
2023-08-23 21:14:45 -04:00
Brandon Thomas
2600762df2
mysql table: media_files
2023-08-23 21:01:49 -04:00
Brandon Thomas
1100fc1a91
clion/intellij formatting rules
2023-08-23 18:03:56 -04:00
Brandon Thomas
a538989c57
UserInfoLite shared response type
2023-08-23 18:03:36 -04:00
Brandon Thomas
a4524ee679
execute all lints and tests
2023-08-23 17:13:11 -04:00
Brandon Thomas
1551a014a4
revisit rustfmt with minimal changes to formatting
2023-08-21 00:59:52 -04:00
Brandon Thomas
e5afff51a6
Change rustfmt rules
2023-08-21 00:32:17 -04:00
Brandon Thomas
9a7b746460
return statement lint
2023-08-21 00:23:09 -04:00
Brandon Thomas
a63b085086
Clippy: fix for newrelic, lint duplicate field name
2023-08-20 21:56:20 -04:00
Brandon Thomas
3b40f005d0
add storyteller.ai hostname
2023-08-20 21:01:57 -04:00
Brandon Thomas
afc4fbdcb5
lints
2023-08-20 20:59:22 -04:00
Brandon Thomas
63008a7fe8
analytics query
2023-08-18 09:01:57 -04:00
Brandon Thomas
902c840833
takedown request
2023-08-18 08:49:05 -04:00
Brandon Thomas
e8a8c6349f
clippy
2023-08-16 16:00:37 -04:00
Brandon Thomas
76a62eaece
more lints (add gradually)
2023-08-16 02:57:06 -04:00
Brandon Thomas
226fb93a36
lint progress
2023-08-16 02:28:48 -04:00
Brandon Thomas
1868170c31
more progress on lints
2023-08-16 01:51:30 -04:00
Brandon Thomas
7ecdac5151
Lint script
2023-08-16 01:34:24 -04:00
Brandon Thomas
f41833e4f4
cargo cranky: &'static
2023-08-15 23:56:03 -04:00
Brandon Thomas
bd9c4d752f
move includes to single root dir
2023-08-15 23:42:01 -04:00
Brandon Thomas
7dab1b9ea1
username reservations
2023-08-14 14:33:32 -04:00
Brandon Thomas
512b214fb8
cargo 'cranky' (clippy helper)
2023-08-10 16:50:25 -04:00
Brandon Thomas
21e2eeac68
remove more duplicates
2023-08-10 15:28:43 -04:00
Brandon Thomas
ec7a61a08e
remove duplicates
2023-08-10 15:00:05 -04:00
Brandon Thomas
c195a23425
inventory duplicates
2023-08-10 14:49:03 -04:00
Brandon Thomas
2c61db12d6
takedown requests
2023-08-10 14:36:24 -04:00
Brandon Thomas
8bac7ca332
analytics queries
2023-08-10 14:22:32 -04:00
Brandon Thomas
56fb99aa81
takedown request
2023-08-07 16:28:58 -04:00
Brandon Thomas
e87091c5cb
re-codegen
2023-07-30 18:13:30 -04:00
Brandon Thomas
ffb081777d
Enrich stats query with per-queue info
2023-07-30 18:12:45 -04:00
Brandon Thomas
e8be6f9775
improved queue length query
2023-07-30 17:26:07 -04:00
Brandon Thomas
2094ab2fe8
query
2023-07-30 16:21:23 -04:00
Brandon Thomas
596434868c
takedown requests, duplicates
2023-07-30 00:15:40 -04:00
Brandon Thomas
14c5f02127
takedown requests
2023-07-30 00:04:07 -04:00
Brandon Thomas
ffc018ee18
broken clients
2023-07-27 23:54:57 -04:00
Brandon Thomas
0b7f08e838
cache queue stats in Redis
2023-07-27 04:03:07 -04:00
Brandon Thomas
3a8398a94e
much better logging for download jobs
2023-07-27 03:10:55 -04:00
Brandon Thomas
35e26e7f72
more queries
2023-07-27 02:48:00 -04:00
Brandon Thomas
3e6b4c43af
scope download job
2023-07-27 01:30:33 -04:00
Brandon Thomas
e5289809fd
more analytics queries
2023-07-26 01:13:38 -04:00
Brandon Thomas
b335e1839c
analytics queries
2023-07-25 16:59:08 -04:00
Brandon Thomas
ce3f83e9af
subscriber analytics
2023-07-24 23:46:36 -04:00
Brandon Thomas
e324c6ce44
query to restart failed downloads
2023-07-24 20:43:38 -04:00
Brandon Thomas
062a80fafa
more analytics, etc. queries
2023-07-24 19:22:47 -04:00
Brandon Thomas
986e8b104a
most popular VC models analytics query
2023-07-24 17:15:06 -04:00
Brandon Thomas
1e948a51e9
logging, common media upload query
2023-07-24 02:06:16 -04:00
Brandon Thomas
f9b7a0e774
fix bug
2023-07-23 23:41:21 -04:00
Brandon Thomas
4db56881c0
debugging type error
2023-07-23 23:36:57 -04:00
Brandon Thomas
c11b2f0a94
better logging
2023-07-23 21:46:26 -04:00
Brandon Thomas
3d9a0cfcc1
scoped job execution
2023-07-23 21:32:39 -04:00
Brandon Thomas
b019968ce1
re codegen db
2023-07-23 19:12:59 -04:00
Brandon Thomas
31c88d6d64
Poll voice conversion model info; pull from cache
2023-07-23 19:12:16 -04:00
Brandon Thomas
a601998fa5
query for voice conversion model info
2023-07-23 18:08:45 -04:00
Brandon Thomas
c1ccfb419a
in-memory token info cache
2023-07-23 17:54:41 -04:00
Brandon Thomas
d9a1fcf989
types on inference jobs are wrong (gradually fixing)
2023-07-23 17:33:57 -04:00
Brandon Thomas
839b33425a
keep alive elapses shouldn't be system failures
2023-07-20 23:58:29 -04:00
Brandon Thomas
8017fef05a
rename files across devices
2023-07-20 23:50:19 -04:00
Brandon Thomas
0534db0033
inference-job: more logging, default location for rvc hubert
2023-07-20 23:30:53 -04:00
Brandon Thomas
ef53568dcf
correct comment
2023-07-20 20:16:58 -04:00
Brandon Thomas
72c5c99a1c
no longer log nvidia-smi spam
2023-07-20 20:16:32 -04:00
Brandon Thomas
0b0a9c428c
fix python logger issue with rvc-v2
2023-07-20 19:58:46 -04:00
Brandon Thomas
a9f0b1d485
fix deletion of directory bug
2023-07-20 18:07:52 -04:00
Brandon Thomas
76dc39df16
Fix list jobs query (now that it isn't statically typed)
2023-07-20 18:04:53 -04:00
Brandon Thomas
79d8af8bf4
re-codegen db
2023-07-20 17:44:03 -04:00
Brandon Thomas
b1d69ba9ac
no-op comment to trigger build
2023-07-20 15:06:17 -04:00
Brandon Thomas
ffcf460291
scope download job type
2023-07-20 14:40:28 -04:00
Brandon Thomas
f0a8b6d175
additional logging for download-job
2023-07-20 01:41:59 -04:00
Brandon Thomas
e3a5d68fcc
download hubert for inference-job
2023-07-20 00:02:41 -04:00
Brandon Thomas
877b95a00c
Download pretrained hubert for download-job
2023-07-19 23:36:38 -04:00
Brandon Thomas
20e32ff3e3
begin handling hubert
2023-07-19 22:35:42 -04:00
Brandon Thomas
97a6f6e4ff
add health checker to download-job
2023-07-19 19:52:24 -04:00
Brandon Thomas
cf27fca799
Merge pull request #52 from storytold/bt-upgrade-actix-4
...
upgrade to actix 4
2023-07-19 02:53:40 -04:00
Brandon Thomas
5eab05753f
fix broken tests
2023-07-19 02:52:11 -04:00
Brandon Thomas
385e1e53c1
update middleware
2023-07-19 02:41:40 -04:00
Brandon Thomas
039e61499f
fix routes generics / upgrade generics on routing pieces
2023-07-19 01:57:51 -04:00
Brandon Thomas
9dd91ce7cc
only a few compile errors left with storyteller-web
2023-07-19 01:09:10 -04:00
Brandon Thomas
a75c1f391a
Upgrade actix partially (was on beta version)
...
Old version was causing conflicts with zip and transitive bzip
dependency, so it's time to upgrade. We need to get to the next version
number soon anyway.
2023-07-19 00:20:49 -04:00
Brandon Thomas
d833b3babd
Merge pull request #51 from storytold/bt-rvc-v2-support
...
RVC v2 support
2023-07-18 23:06:49 -04:00
Brandon Thomas
1427e3eecd
Handle zip files with .index files
2023-07-18 23:05:46 -04:00
Brandon Thomas
45990f5631
research
2023-07-18 17:57:37 -04:00
Brandon Thomas
5653a918c0
codegen db (was there an sqlite issue?)
2023-07-18 16:53:08 -04:00
Brandon Thomas
8172774a98
Handle RVC models without an index file
2023-07-18 16:50:44 -04:00
Brandon Thomas
6189d6fe9d
working rvc(v2), it needs cleanup; also fixed race condition
2023-07-18 02:13:46 -04:00
Brandon Thomas
395940ef34
Progress on rvc inference job (not working yet)
2023-07-18 01:55:39 -04:00
Brandon Thomas
85cfc0cf2e
env files
2023-07-18 00:10:57 -04:00
Brandon Thomas
93e066e70b
fixing rvc uploads
2023-07-17 17:10:14 -04:00
Brandon Thomas
5cb79a5a33
Begin work on download-job rvc-v2 support
2023-07-17 16:24:35 -04:00
Brandon Thomas
6b06a825f3
Merge pull request #50 from storytold/bt-saj-rvc-integration
...
Bt saj rvc integration
2023-07-16 19:26:23 -04:00
Brandon Thomas
d653260ee5
Change enum variant name
2023-07-16 19:22:00 -04:00
Paul Sajna
c8530e186e
rvc stubs
2023-07-15 21:56:46 -04:00
Brandon Thomas
aee52c04ff
Fix failing builds (everything was working before)
...
Something mysteriously made my machine think we needed nightly.
Begone, nightly.
2023-07-15 21:55:59 -04:00
Brandon Thomas
cd91acb4a8
fix compile error
2023-07-15 21:13:37 -04:00
Brandon Thomas
d591472478
Merge pull request #49 from storytold/new-queries
...
new queries
2023-07-14 10:59:11 -04:00
Brandon Thomas
c14073f06d
new queries
2023-07-14 10:58:34 -04:00
Brandon Thomas
edde256ff6
delete more duplicates
2023-06-27 15:33:50 -07:00
Brandon Thomas
c6bcd25b19
get rid of takedown request models, duplicate models
2023-06-27 15:20:37 -07:00
Brandon Thomas
82c1563459
comments about users
2023-06-25 21:51:18 -07:00
Brandon Thomas
866ed89d9c
refactor disabled endpoint filter
2023-06-25 21:21:53 -07:00
Brandon Thomas
ac4ffb4f34
refactor
2023-06-25 20:57:36 -07:00
Brandon Thomas
41fe0866d4
refactor ip filter
2023-06-25 20:42:06 -07:00
Brandon Thomas
de3e2e8924
cidr refactor
2023-06-25 20:28:31 -07:00
Brandon Thomas
800c9bd9d5
Add cidr filter
2023-06-25 20:11:59 -07:00
Brandon Thomas
1fe62a2570
Actix CIDR filter
2023-06-25 19:59:01 -07:00
Brandon Thomas
f293b56089
Merge pull request #47 from storytold/bt-block-alibaba
...
block a few Alibaba IPs
2023-06-23 21:23:43 -04:00
Brandon Thomas
a0a2d1434f
block a few Alibaba IPs
2023-06-23 18:23:03 -07:00
Brandon Thomas
8ba1d9f303
Merge pull request #45 from storytold/bevy-experiments
...
roko bevy testing
2023-06-20 10:17:23 -04:00
Paul Sajna
a11779e3aa
roko bevy testing
2023-06-19 11:31:32 -07:00
Brandon Thomas
5c46fd7c60
easier to see logs in k8s
2023-06-17 19:02:28 -07:00
Brandon Thomas
09e26164b8
even beefier build machines
2023-06-17 18:32:58 -07:00
Brandon Thomas
8c24b0c755
log job successes
2023-06-17 18:18:15 -07:00
Brandon Thomas
83ae73d8d0
improperly counting successes
2023-06-17 18:05:34 -07:00
Brandon Thomas
1d0db0eeb9
install nvidia-container packages
2023-06-17 16:12:19 -07:00
Brandon Thomas
04581d06ee
better exit status
2023-06-17 14:14:29 -07:00
Brandon Thomas
a31ecc01ab
configurable health threshold
2023-06-17 11:43:25 -07:00
Brandon Thomas
be20e105ea
Health check HTTP server runs and shuts down
2023-06-17 11:39:34 -07:00
Brandon Thomas
67864f3db2
Both job and HTTP server (doesn't respond to ctrl-c)
2023-06-17 11:05:27 -07:00
Brandon Thomas
10c277d9cf
health check endpoint (not installed)
2023-06-17 07:49:27 -07:00
Brandon Thomas
c6e4c2e274
job stats (consecutive success, failure) for inference-job
2023-06-16 21:42:00 -07:00
Brandon Thomas
a3815ad64d
Merge pull request #43 from storytold/saj-audiowmark
...
audiowmark wrapper
2023-05-29 23:23:37 -04:00
Paul Sajna
8cd48fcf58
audiowmark wrapper
2023-05-29 20:15:45 -07:00
Brandon Thomas
523c02326b
more logging
2023-05-28 22:34:48 -07:00
Brandon Thomas
37eef276a0
more logger methods
2023-05-28 21:20:30 -07:00
Brandon Thomas
f5cbedb230
fix logger
2023-05-28 21:01:14 -07:00
Brandon Thomas
6994a9c2ce
documentation
2023-05-28 19:07:45 -07:00
Brandon Thomas
213742ff29
override python logger in dockerfile
2023-05-28 19:05:51 -07:00
Brandon Thomas
df4f1e6a6c
fix log levels
2023-05-28 19:04:09 -07:00
Brandon Thomas
64fa281bc1
parameter for flushing logs
2023-05-28 18:52:01 -07:00
Brandon Thomas
bd386aa70b
don't need the logger.py in isolation
2023-05-28 18:16:35 -07:00
Brandon Thomas
28875c9272
Add patches to upstream logger
2023-05-28 18:16:11 -07:00
Brandon Thomas
a79bfc7a24
add version of logger we're using in production - we'll patch instead
2023-05-28 17:42:32 -07:00
Brandon Thomas
ecca8ff17c
we'll need to replace python logging in our container for performance
2023-05-28 17:33:04 -07:00
Brandon Thomas
a3cabf6779
fix import
2023-05-28 00:53:59 -07:00
Brandon Thomas
dd35a7cca9
ignore sensitive env vars
2023-05-28 00:52:05 -07:00
Brandon Thomas
f876cac4cf
job pause file
2023-05-27 23:23:42 -07:00
Brandon Thomas
d2b840cb13
analytics queries
2023-05-27 00:32:09 -07:00
Brandon Thomas
85bac00194
password_reset table
2023-05-23 02:12:58 -07:00
Brandon Thomas
367a516f89
fix option typo
2023-05-23 01:41:01 -07:00
Brandon Thomas
5fe85072a2
pack more in docker container, "hacky fix" flag for so-vits-svc
2023-05-23 00:16:11 -07:00
Brandon Thomas
5867d2356c
install vim
2023-05-22 22:21:53 -07:00
Brandon Thomas
275333c1ed
netstat in docker image
2023-05-22 17:44:41 -07:00
Brandon Thomas
5ec2cde68f
report errors better
2023-05-22 11:15:19 -07:00
Brandon Thomas
daf5a63f86
cleanup temp dir
2023-05-22 02:44:34 -07:00
Brandon Thomas
2fe3d5dc99
add less to container
2023-05-22 02:38:20 -07:00
Brandon Thomas
44df952bd1
fix inference job path for VC uploaded audio
2023-05-22 01:51:12 -07:00
Brandon Thomas
5bf98f70d9
rework where temp storage lives: download vs workspace
2023-05-22 00:52:49 -07:00
Brandon Thomas
af685b37cf
fix keepalive redis in job
2023-05-21 22:11:19 -07:00
Brandon Thomas
0f7ff50cf6
better error logging
2023-05-21 20:01:08 -07:00
Brandon Thomas
1ae8d8d615
Fail jobs with elapsed keepalive
2023-05-21 18:16:44 -07:00
Brandon Thomas
63c0124267
test execution safety
2023-05-21 17:52:53 -07:00
Brandon Thomas
17e8c1942e
codegen db
2023-05-21 17:49:58 -07:00
Brandon Thomas
cf24a07bba
Set keepalive key
2023-05-21 17:48:29 -07:00
Brandon Thomas
9ece30722f
Enqueue inferene with keepalive flag
2023-05-21 17:21:17 -07:00
Brandon Thomas
9ab977d016
Add job table keepalive column
2023-05-21 17:04:02 -07:00
Brandon Thomas
ebd3f52717
tmux to gpu container
2023-05-19 04:22:53 -07:00
Brandon Thomas
35a75e144a
unban IP
2023-05-19 04:08:29 -07:00
Brandon Thomas
4b145a7419
Patch for firefox opus audio uploads failing
2023-05-19 04:06:36 -07:00
Brandon Thomas
eb539e9142
query was wrong
2023-05-19 02:08:51 -07:00
Brandon Thomas
37604cdd7b
config
2023-05-19 02:48:22 -04:00
Brandon Thomas
f724031aa3
config
2023-05-19 02:44:14 -04:00
Brandon Thomas
b8b10f6fc1
f0-method and frequency transpose for job
2023-05-18 12:17:08 -07:00
Brandon Thomas
bd4bcab2c2
args for pitch/f0 method in http handler
2023-05-18 00:14:42 -07:00
Brandon Thomas
caa3e3ae53
clear filesystem when full
2023-05-16 01:13:54 -07:00
Brandon Thomas
7cd8099ab5
variable length tts inference text
2023-05-15 00:47:57 -07:00
Brandon Thomas
6ec39b9c68
loyalty for VC contributors
2023-05-14 21:00:27 -07:00
Brandon Thomas
c8b4b7daa0
analytics queries
2023-05-13 09:27:57 -07:00
Brandon Thomas
a294549d02
queries
2023-05-09 12:55:07 -04:00
Brandon Thomas
33ff75274f
add ripgrep
2023-05-04 06:17:12 -07:00
Brandon Thomas
945e5226c5
add a few tools to the container
2023-05-04 03:47:54 -07:00
Brandon Thomas
85a52cd26e
config comments
2023-05-04 03:09:23 -04:00
Brandon Thomas
32ee4209da
this configuration works
2023-05-04 03:07:38 -04:00
Brandon Thomas
f94cdac47d
local dev confi
2023-05-03 23:18:53 -04:00
Brandon Thomas
a2ea870ac7
update nvidia driver ???
2023-05-02 23:01:29 -07:00
Brandon Thomas
a2c48d7469
kill subprocess if timeout elapses
2023-05-02 22:19:03 -07:00
Brandon Thomas
fe3dd7d66b
add routing tags to inference jobs
2023-05-02 21:31:39 -07:00
Brandon Thomas
88fae4ba89
timeout argument
2023-05-02 06:12:49 -07:00
Brandon Thomas
6505e67bf2
analytics
2023-05-02 04:37:21 -07:00
Brandon Thomas
3453fe0e3b
add minor logging
2023-05-02 01:18:25 -07:00
Brandon Thomas
8b36d870d1
fix inference job, add env perameter for threshold
2023-05-01 06:52:34 -07:00
Brandon Thomas
9555ac51fe
Skip jobs that aren't on filesystem
2023-05-01 06:42:41 -07:00
Brandon Thomas
f00b4011b5
record inferecne duration stats to db
2023-05-01 04:17:36 -07:00
Brandon Thomas
d1d208d714
add more timing stats to the jobs tables
2023-05-01 03:59:05 -07:00
Brandon Thomas
a5ce9a3cc4
analytics
2023-04-30 08:16:27 -07:00
Brandon Thomas
6ad2468e59
analytics queries
2023-04-30 08:09:07 -07:00
Brandon Thomas
c59695343f
extend media/symphonia to work with webm+opus
2023-04-30 05:03:40 -07:00
Brandon Thomas
52a83609b6
test case for failing web browser uploads
2023-04-30 00:31:03 -07:00
Brandon Thomas
f710b68a3e
Fix broken tests, add testing script
2023-04-29 23:56:48 -07:00
Brandon Thomas
3d63e34ca1
analytics queries
2023-04-29 23:36:02 -07:00
Brandon Thomas
4a1f1441bf
split analytics and operational queries
2023-04-29 06:08:34 -07:00
Brandon Thomas
ee90f03436
add extra inference job stats
2023-04-29 05:11:57 -07:00
Brandon Thomas
1858aea619
new job queue stats endpoint
2023-04-29 04:58:51 -07:00
Brandon Thomas
592ba627be
documentation
2023-04-29 03:53:31 -07:00
Brandon Thomas
f754c6e41f
add execution time to job queries
2023-04-29 03:10:31 -07:00
Brandon Thomas
54af3d301c
Add execution millis columns to jobs tables
2023-04-29 02:41:49 -07:00
Brandon Thomas
22eeacf355
stricter compiler flags
2023-04-29 02:30:41 -07:00
Brandon Thomas
630aa497f3
note
2023-04-29 02:28:32 -07:00
Brandon Thomas
6e9c05c596
bootstrap / env config improved, on-prem, etc.
2023-04-29 02:26:13 -07:00
Brandon Thomas
3f781ad98f
clean up worker hostname / cluster name in jobs
2023-04-29 02:16:17 -07:00
Brandon Thomas
5d038fdf8f
codegen db
2023-04-29 01:50:14 -07:00
Brandon Thomas
a09acf7c53
add extra metadata to inference and download jobs
2023-04-29 01:49:25 -07:00
Brandon Thomas
3ba64618c3
add tracking columns to generic_inference_job too
2023-04-29 00:17:44 -07:00
Brandon Thomas
73e583c7ed
Add extra metadata tracking to generic download jobs table
2023-04-29 00:08:54 -07:00
Brandon Thomas
1d7a54f640
python for docker image
2023-04-28 16:09:38 -07:00
Brandon Thomas
552fae54a7
fix
2023-04-28 16:02:04 -07:00
Brandon Thomas
4d2ae85fd9
send hubert path for docker
2023-04-28 16:01:18 -07:00
Brandon Thomas
76775dec60
hubert path config
2023-04-28 15:54:53 -07:00
Brandon Thomas
22bc8d54a0
organize settings
2023-04-28 18:46:18 -04:00
Brandon Thomas
878bff867a
fix dev env vars
2023-04-28 02:01:11 -04:00
Brandon Thomas
05d5bfc1a7
rename
2023-04-27 23:00:16 -07:00
Brandon Thomas
3acdd0b5e2
rebase fix
2023-04-28 01:47:40 -04:00
Brandon Thomas
1a7a74ee8a
so-vits-svc auto_predict_f0 default to false, add option
2023-04-27 22:45:28 -07:00
Brandon Thomas
820f4ebc32
fix firefox/opus again
2023-04-27 15:54:13 -07:00
Brandon Thomas
423fb369db
add audio/opus
2023-04-27 08:15:46 -07:00
Brandon Thomas
2a58079289
copy all env vars to child process
2023-04-27 07:19:46 -07:00
Brandon Thomas
b2df674178
report mimetype errors
2023-04-27 02:00:31 -07:00
Brandon Thomas
1fd33e76b4
update base image
2023-04-27 01:02:23 -07:00
Brandon Thomas
824683b974
fixup dockerfile
2023-04-27 00:50:45 -07:00
Brandon Thomas
4bed11d21d
change name again
2023-04-27 00:12:48 -07:00
Brandon Thomas
13bdcbdda6
fix names of actions
2023-04-27 00:11:40 -07:00
Brandon Thomas
f49c724303
GPU + CPU dockerfiles
2023-04-27 00:09:31 -07:00
Brandon Thomas
a9502c183b
flexible config path for inference job
2023-04-26 10:17:49 -07:00
Brandon Thomas
b469a237ce
temporarily add nvidia/sound packages to rust monorepo images
2023-04-26 09:14:17 -07:00
Brandon Thomas
0df93c48c3
configs for download job
2023-04-26 07:48:31 -07:00
Brandon Thomas
070c192633
set config and test wav upfront and at runtime
2023-04-26 07:43:59 -07:00
Brandon Thomas
75a68c7e0f
install python
2023-04-26 05:45:28 -07:00
Brandon Thomas
b2db079cf5
env vars for docker
2023-04-26 04:46:40 -07:00
Brandon Thomas
6658281a1c
try more env vars for caching
2023-04-26 04:38:27 -07:00
Brandon Thomas
8cb04f1dcb
huggingface+nltk caches
2023-04-26 04:25:43 -07:00
Brandon Thomas
58f6ee68df
more flexible command specification
2023-04-26 04:11:06 -07:00
Brandon Thomas
d0cef7bec9
hack
2023-04-26 03:30:38 -07:00
Brandon Thomas
8eed406fbd
inference-job hack (see if we can run without 'svc' command)
2023-04-26 01:31:02 -07:00
Brandon Thomas
44586c4cee
copy the correct env var files
2023-04-25 20:56:18 -07:00
Brandon Thomas
02f5aacb8e
more robust configuration of download-job
2023-04-25 20:55:18 -07:00
Brandon Thomas
001ff86ed3
robust configuration for download-job
2023-04-25 20:51:51 -07:00
Brandon Thomas
94b406eca2
much more robust app initialization
2023-04-25 20:44:59 -07:00
Brandon Thomas
f8bdea1b3b
build error fix
2023-04-25 17:20:21 -07:00
Brandon Thomas
8a37a7240c
more DDoS IPs
2023-04-25 17:16:29 -07:00
Brandon Thomas
a4c1abfe9c
codegen
2023-04-25 06:07:01 -07:00
Brandon Thomas
6bb7a18676
report model title
2023-04-25 04:13:28 -07:00
Brandon Thomas
a8173226ea
report bucket hash in results
2023-04-25 03:00:31 -07:00
Brandon Thomas
692c3f64b6
two different firehose notifications
2023-04-25 01:33:47 -07:00
Brandon Thomas
4842b9bbc1
local dev config changes
2023-04-25 04:28:00 -04:00
Brandon Thomas
a507f8bc38
nope, didn't work
2023-04-25 01:27:28 -07:00
Brandon Thomas
24f2c07199
try to fix duration bug
2023-04-25 01:25:13 -07:00
Brandon Thomas
e871dde078
add upload source
2023-04-25 01:09:24 -07:00
Brandon Thomas
47ff379018
timeout
2023-04-24 02:53:59 -07:00
Brandon Thomas
cdb0f37889
downgrode symphonia off-master branch to support opus for browsers
2023-04-24 02:32:13 -07:00
Brandon Thomas
6d7c3c6e5f
maybe build with correct codecs?
2023-04-24 01:46:52 -07:00
Brandon Thomas
7b72d51bd3
debug logging
2023-04-24 01:11:37 -07:00
Brandon Thomas
11a9e1249c
remove inference args (for now)
2023-04-23 23:29:09 -07:00
Brandon Thomas
f3a6ddb70a
premium priority levels
2023-04-23 23:05:24 -07:00
Brandon Thomas
d2aa07228b
simplify upload endpoint
2023-04-23 22:30:13 -07:00
Brandon Thomas
a2c3668beb
upload audio endpoint
2023-04-23 22:25:46 -07:00
Brandon Thomas
15d66a4530
propagate media input token to inference result
2023-04-23 20:48:09 -07:00
Brandon Thomas
75523811e4
ops query
2023-04-23 13:59:01 -07:00
Brandon Thomas
4672102da4
code changes stemming from schema changes
2023-04-23 05:03:37 -07:00
Brandon Thomas
ca59189dd9
simplify media_uploads schema
2023-04-23 04:31:00 -07:00
Brandon Thomas
3564c1b459
more schema mods
2023-04-23 04:13:50 -07:00
Brandon Thomas
78263e3c49
media token type
2023-04-23 03:58:16 -07:00
Brandon Thomas
e36fb66e05
migrate voice_conversion_results
2023-04-23 03:24:05 -07:00
Brandon Thomas
1540d87018
cleanup
2023-04-23 02:12:46 -07:00
Brandon Thomas
61f0869359
calculate result metadata
2023-04-23 02:02:49 -07:00
Brandon Thomas
d23c7abfeb
remove deprecated crate -> move hashing + mimetype functions out
2023-04-23 01:31:58 -07:00
Brandon Thomas
2d59891dee
organize "file"-related/adjacent crates together
2023-04-23 00:27:09 -07:00
Brandon Thomas
2f86bc75ac
crate to handle just mimetype ops
2023-04-23 00:08:59 -07:00
Brandon Thomas
8c5fb0bee2
badge granter for voice conversion models
2023-04-22 06:22:06 -07:00
Brandon Thomas
b9f0d7749d
fix transaction
2023-04-22 05:36:22 -07:00
Brandon Thomas
b2caa3758a
fix synthetic id
2023-04-22 05:22:06 -07:00
Brandon Thomas
de656d4d74
fix
2023-04-22 04:47:09 -07:00
Brandon Thomas
c803232a52
creator synthetic id
2023-04-22 04:44:40 -07:00
Brandon Thomas
cd9b0080dd
fix result upload directory
2023-04-22 04:04:15 -07:00
Brandon Thomas
6885eb5fc9
temporarily don't get file metadata
2023-04-22 03:55:25 -07:00
Brandon Thomas
100ad0da35
use public bucket client
2023-04-22 03:48:52 -07:00
Brandon Thomas
7010d56bc3
error handling json hydration
2023-04-22 03:44:10 -07:00
Brandon Thomas
b34371eef0
try to only parse payload if not empty string
2023-04-22 03:42:29 -07:00
Brandon Thomas
e6542438b5
create model storage directory
2023-04-22 03:29:26 -07:00
Brandon Thomas
287e3e5f0c
inference for local dev
2023-04-22 02:17:58 -07:00
Brandon Thomas
8fcb908af9
code compiles
2023-04-22 02:14:44 -07:00
Brandon Thomas
56e84f434f
forgot schema migrations
2023-04-22 02:05:44 -07:00
Brandon Thomas
925f2d78ae
more sane schema for voice conversion results (bucket storage)
2023-04-22 02:04:44 -07:00
Brandon Thomas
90219594bb
insert result record
2023-04-22 01:43:24 -07:00
Brandon Thomas
08e8560499
voice conversion result upload (WIP)
2023-04-21 23:27:20 -07:00
Brandon Thomas
9e38b9a2fc
progress on so-vits-svc inference
2023-04-21 23:12:24 -07:00
Brandon Thomas
e9a6320eab
so-vits-svc inference (wip)
2023-04-21 21:51:37 -07:00
Brandon Thomas
da05885d7d
don't upload duplicates
2023-04-21 05:54:10 -07:00
Brandon Thomas
ba9f716ff8
encode fewer bytes in inference jobs
2023-04-21 02:24:23 -07:00
Brandon Thomas
2633c5f0ef
clean up tokens in vc inference
2023-04-21 02:05:14 -07:00
Brandon Thomas
da805b4f1d
clean upload hashing, better error messages
2023-04-21 00:22:58 -07:00
Brandon Thomas
9eb75c7eba
list media uploads by session
2023-04-20 01:40:36 -07:00
Brandon Thomas
75607b3c12
tests, aspath
2023-04-20 00:27:37 -07:00
Brandon Thomas
ce69b1b055
filesys crate cleanup
2023-04-20 00:18:29 -07:00
Brandon Thomas
9ee7fdbac5
move endpoint
2023-04-19 01:18:07 -07:00
Brandon Thomas
67e3ecebc1
Voice conversion model list endpoint
2023-04-19 00:43:27 -07:00
Brandon Thomas
52db0b7796
python3.6
2023-04-18 15:46:08 -07:00
Brandon Thomas
15fa5a2bee
update image
2023-04-18 15:44:58 -07:00
Brandon Thomas
32babc99f0
update image
2023-04-18 12:47:58 -07:00
Brandon Thomas
bdac796e51
update tt2 legacy inference to support docker, etc, unfront config
2023-04-18 12:37:30 -07:00
Brandon Thomas
18c50af218
Add "Deepfake CNN" level
2023-04-16 02:54:57 -07:00
Brandon Thomas
62cbde94bc
anderson cooper voice config
2023-04-15 23:43:54 -07:00
Brandon Thomas
b2f9b44e96
uncommitted changes
2023-04-15 23:36:26 -07:00
Brandon Thomas
6a48a5372c
fix arg
2023-04-13 16:58:26 -07:00
Brandon Thomas
1b0368664a
update image
2023-04-13 19:53:37 -04:00
Brandon Thomas
6a83524fd9
switch from 'onnx' to 'infer' for checking model integrity
2023-04-13 16:48:14 -07:00
Brandon Thomas
233247f3c0
config path
2023-04-13 15:59:16 -07:00
Brandon Thomas
60045a01d0
fix command
2023-04-13 13:33:57 -07:00
Brandon Thomas
dc5dfd9831
update docker image
2023-04-13 13:24:07 -07:00
Brandon Thomas
7b36fc0b98
Update model check command (so-vits-svc), upgrade easyenv
2023-04-13 12:52:18 -07:00
Brandon Thomas
92e1d10809
wip so-vits-svc
2023-04-12 02:53:57 -07:00
Brandon Thomas
4a486cedd2
add so-vits-svc download type
2023-04-10 01:39:54 -07:00
Brandon Thomas
004cde84a7
move enum
2023-04-09 23:03:15 -07:00
Brandon Thomas
61b74500d8
codegen, a few enums
2023-04-09 22:55:21 -07:00
Brandon Thomas
8285826ed0
move where config lives
2023-04-09 20:16:13 -07:00
Brandon Thomas
03d0110ee6
ml docker image
2023-04-09 23:02:57 -04:00
Brandon Thomas
34517fbaff
fix build errors
2023-04-09 19:18:07 -07:00
Brandon Thomas
839f7885fb
try another path
2023-04-09 02:58:23 -07:00
Brandon Thomas
cee3ffb217
fix docker env vars
2023-04-09 02:29:22 -07:00
Brandon Thomas
90198252b8
nltk env var
2023-04-09 02:24:41 -07:00
Brandon Thomas
165130321f
try setting cache dir with docker now
2023-04-09 02:10:34 -07:00
Brandon Thomas
061c2c7b07
try to move cache dir again
2023-04-09 01:46:37 -07:00
Brandon Thomas
413960b6cf
actually pass env to popen
2023-04-09 01:37:33 -07:00
Brandon Thomas
cc4b7deaa9
huggingface cache dir
2023-04-09 01:27:50 -07:00
Brandon Thomas
8229a3cfb3
record entity token/type after job completes
2023-04-08 22:59:16 -07:00
Brandon Thomas
b461c7e8e7
make field optional
2023-04-08 21:03:07 -07:00
Brandon Thomas
c58f23c117
fixup inference-job
2023-04-08 20:52:51 -07:00
Brandon Thomas
048cc26b6b
fixup storyteller-web
2023-04-08 20:50:22 -07:00
Brandon Thomas
9b5508d8c0
fixup mysql queries
2023-04-08 20:41:10 -07:00
Brandon Thomas
a81428913d
migrate generic_inference_jobs to include better indices/foreign keys
2023-04-08 19:54:58 -07:00
Brandon Thomas
756c8e09ae
inference status endpoints
2023-04-08 18:49:59 -07:00
Brandon Thomas
5b97360724
update upload routes
2023-04-08 01:09:22 -07:00
Brandon Thomas
79ad78bdde
header to route TT2 requests to new worker
2023-04-06 22:00:44 -07:00
Brandon Thomas
311299105b
updated docker image
2023-04-07 00:48:24 -04:00
Brandon Thomas
9dad3a153c
ml repo update
2023-04-06 22:50:21 -04:00
Brandon Thomas
93157b50c8
vits inference command roughly done, need to test
2023-04-06 18:58:07 -07:00
Brandon Thomas
47fbc1704d
analytics
2023-04-06 16:48:31 -07:00
Brandon Thomas
efba106d3c
analytics query
2023-04-06 16:26:06 -07:00
Brandon Thomas
e340eee250
progress on VITS (WIP)
2023-04-06 16:02:01 -07:00
Brandon Thomas
73be1bbf05
git rid of dated enum, start work on VITS inference
2023-04-06 14:35:29 -07:00
Brandon Thomas
81306d1a56
(untested) route VITS tts to generic job type
2023-04-05 01:48:50 -07:00
Brandon Thomas
8e341f7a83
strongly typed tts model type
2023-04-05 01:21:31 -07:00
Brandon Thomas
1978e5e653
db index on tts_models.tts_model_type
2023-04-05 00:53:52 -07:00
Brandon Thomas
8eaaad9b55
fix path error
2023-04-04 15:01:04 -07:00
Brandon Thomas
082c284add
debugging
2023-04-04 14:47:15 -07:00
Brandon Thomas
a83e5ff224
logging
2023-04-04 14:25:50 -07:00
Brandon Thomas
abaaaf2fdb
dev
2023-04-04 14:12:33 -07:00
Brandon Thomas
3409689566
fix path handling, introduce another (smaller scope) filesystem crate
2023-04-04 13:59:21 -07:00
Brandon Thomas
84c0e42964
fmt
2023-04-04 12:53:09 -07:00
Brandon Thomas
b848c2b549
update docker image for appropriate cuda version
2023-04-04 15:50:06 -04:00
Brandon Thomas
85abbd8587
set python intepreter, fix path
2023-04-04 03:14:40 -07:00
Brandon Thomas
b844191db7
downloader image
2023-04-04 06:08:19 -04:00
Brandon Thomas
0267a4799d
fix a few errors with paths and quoting
2023-04-04 03:07:54 -07:00
Brandon Thomas
c50060b161
no vits download venv
2023-04-04 02:57:39 -07:00
Brandon Thomas
a508a843bd
root dir
2023-04-04 02:56:25 -07:00
Brandon Thomas
d0bad0c8fb
docker image for testing
2023-04-04 05:50:48 -04:00
Brandon Thomas
d2c99a7bad
configure download-job for VITS (wip)
2023-04-04 00:24:28 -07:00
Brandon Thomas
681d923ae0
Add 'vits' enum to tts model tables
2023-04-04 00:11:48 -07:00
Brandon Thomas
9e563a0640
VITS download WIP (nearly done)
2023-04-03 23:41:18 -07:00
Brandon Thomas
db30096cb9
rename module in inference-job
2023-04-03 21:43:42 -07:00
Brandon Thomas
76f9f5a850
Refactor download job, begin to work on VITS downloading
2023-04-03 21:37:07 -07:00
Brandon Thomas
3a0eafee11
report back on how to handle the upload
2023-04-02 21:34:38 -07:00
Brandon Thomas
9fbecd5568
enqueue vits uploads (in theory)
2023-04-02 21:21:16 -07:00
Brandon Thomas
b3dedfc5a8
WIP VITS uploads
2023-04-02 21:05:05 -07:00
Brandon Thomas
8ded313e7b
configure storyteller-web with more db (why so slow in dev?!)
2023-04-02 20:23:12 -07:00
Brandon Thomas
e305928b45
flexible docker image sha
2023-04-02 20:01:45 -07:00
Brandon Thomas
db48ee0fd8
mac frontend cors
2023-04-01 05:40:25 -04:00
Brandon Thomas
5beedcb5e3
add one color
2023-03-25 23:12:14 -04:00
Brandon Thomas
e43feeb700
add random avatar/color to several endpoints
2023-03-25 19:54:12 -04:00
Brandon Thomas
38dc835ff4
add to event feed
2023-03-25 19:33:59 -04:00
Brandon Thomas
62b19b2b0e
functions to generate random avatar + color
2023-03-25 19:04:37 -04:00
Brandon Thomas
b7b92f4419
reduce user tokens to a single list
2023-03-23 02:49:33 -04:00
Brandon Thomas
7ee7ff3875
split ipv4/ipv6 files
2023-03-23 02:44:28 -04:00
Brandon Thomas
29237d3ead
user tokens
2023-03-23 02:42:05 -04:00
Brandon Thomas
5afbfc0ec4
change troll sequences
2023-03-23 02:32:05 -04:00
Brandon Thomas
6e5a2d1789
more accounts
2023-03-23 02:13:07 -04:00
Brandon Thomas
13281ea3b1
more accounts
2023-03-23 02:10:36 -04:00
Brandon Thomas
98f80a68de
documentation on removed ipv6 bans (in cloudflare, not our code)
2023-03-23 01:55:34 -04:00
Brandon Thomas
075fcfb81e
unblock ipv6
2023-03-23 01:42:27 -04:00
Brandon Thomas
a8c45cfac2
more accounts
2023-03-23 01:40:56 -04:00
Brandon Thomas
f0a4f0a4f7
more ips / accounts
2023-03-23 01:09:24 -04:00
Brandon Thomas
3b78853d7c
new user tokens and ip addresses
2023-03-23 01:03:58 -04:00
Brandon Thomas
98b6bb34a7
lighten up on the troll text
2023-03-23 01:02:18 -04:00
Brandon Thomas
4d759719f6
more IPs and user tokens
2023-03-23 00:52:41 -04:00
Brandon Thomas
ac28ff8a39
start blocking 101soundboards IPs too
2023-03-23 00:50:03 -04:00
Brandon Thomas
43a33a00ee
gitignore
2023-03-23 00:43:27 -04:00
Brandon Thomas
8bbc490b61
ignore vim temp files
2023-03-23 00:43:01 -04:00
Brandon Thomas
168a476b72
user token + ip address troll bans
2023-03-23 00:28:00 -04:00
Brandon Thomas
2cebfbb3fc
more 101soundboards user tokens
2023-03-23 00:12:44 -04:00
Brandon Thomas
d57e070c8c
dedup
2023-03-22 23:58:06 -04:00
Brandon Thomas
bde6b4d562
more user tokens
2023-03-22 23:56:12 -04:00
Brandon Thomas
9cde097d38
more stupid accounts
2023-03-22 23:53:13 -04:00
Brandon Thomas
1d7d1ba194
more 101soundboards user tokens
2023-03-22 23:50:36 -04:00
Brandon Thomas
632cf5a710
more 101soundboards user tokens
2023-03-22 23:40:19 -04:00
Brandon Thomas
c2e287f6f4
more damned accounts
2023-03-22 22:55:26 -04:00
Brandon Thomas
844799e30e
more 101soundboards accounts
2023-03-22 22:49:38 -04:00
Brandon Thomas
c1bd8ed611
actually fix builds
2023-03-22 19:57:04 -04:00
Brandon Thomas
1466bca4d7
fix build
2023-03-22 18:32:36 -04:00
Brandon Thomas
12fdf24028
temp disable build
2023-03-22 18:28:24 -04:00
Brandon Thomas
cefb770340
codegen db
2023-03-22 16:49:24 -04:00
Brandon Thomas
e971ea98dc
fix troll bans
2023-03-22 16:47:10 -04:00
Brandon Thomas
9ab8b366e9
ban 101 soundboards
2023-03-22 16:24:23 -04:00
Brandon Thomas
96563fa345
add a means to ban user tokens (or disable the service in weird ways)
2023-03-22 16:05:09 -04:00
Brandon Thomas
67ab94664c
working locally
2023-03-22 15:34:02 -04:00
Brandon Thomas
99f1226115
I have to run this under Docker locally since it's ancient
2023-03-21 05:35:08 -04:00
Brandon Thomas
9c45a17b8d
new inference subprocess command
2023-03-21 05:18:07 -04:00
Brandon Thomas
2cf5a6f942
TTS inference almost working on generic-inference-job
2023-03-21 02:01:13 -04:00
Brandon Thomas
071928d7bf
port more TT2 logic
2023-03-21 00:49:21 -04:00
Brandon Thomas
b8442b54ee
cleanup
2023-03-21 00:18:39 -04:00
Brandon Thomas
530d891ce9
about to bolt on TT2
2023-03-21 00:11:42 -04:00
Brandon Thomas
972f119468
query tts model
2023-03-20 23:57:44 -04:00
Brandon Thomas
9004432620
generic inference jobs can be listed (hacky fix)
2023-03-20 23:42:23 -04:00
Brandon Thomas
81a3bc270b
fix generic job list query
2023-03-20 23:11:38 -04:00
Brandon Thomas
84fe5a5762
enqueue generic inference jobs for tt2
2023-03-20 22:28:59 -04:00
Brandon Thomas
a02934ca4e
Add routing column to inference jobs (wip)
2023-03-20 21:58:08 -04:00
Brandon Thomas
4ddcd43e33
remove a lot of garbage from inference-job
2023-03-20 20:04:49 -04:00
Brandon Thomas
37be0174af
put inference job back into "working"(?) order
2023-03-20 19:29:06 -04:00
Brandon Thomas
f2e314d168
make sure this gets put in the image
2023-03-20 19:23:54 -04:00
Brandon Thomas
3bd216f00d
rename crate, fix path handling, move some env vars
2023-03-20 19:21:58 -04:00
Brandon Thomas
dc5885114d
env internal crate - search multiple directories for env files
2023-03-20 18:59:43 -04:00
Brandon Thomas
47873497b8
comment APIs needed disambiguation
2023-03-18 18:18:45 -04:00
Brandon Thomas
554766bd2a
Don't load IP ban sets that are empty
2023-03-18 13:25:14 -04:00
Brandon Thomas
86382bf219
rename files for better sorting
2023-03-18 13:13:54 -04:00
Brandon Thomas
59b1e28a14
unban IP
2023-03-18 13:12:52 -04:00
Brandon Thomas
3f88a741c9
private model logging + fix(?)
2023-03-18 13:06:19 -04:00
Brandon Thomas
2efcba5da6
fix broken path
2023-03-18 13:00:19 -04:00
Brandon Thomas
b4718a2f13
block broken python script IP 104.251.211.22
2023-03-18 12:59:19 -04:00
Brandon Thomas
efbb0000f3
fix list comment route
2023-03-18 07:02:50 -04:00
Brandon Thomas
0280e6b706
let's not do this table just yet
2023-03-18 05:37:14 -04:00
Brandon Thomas
79d568ee14
codegen db
2023-03-18 04:51:35 -04:00
Brandon Thomas
85630390a0
route bindings, list endpoint
2023-03-18 04:33:53 -04:00
Brandon Thomas
215b727bc1
create comment, delete comment handlers (not tested)
2023-03-18 03:54:30 -04:00
Brandon Thomas
e29c0b4c68
edit comment query
2023-03-18 02:13:46 -04:00
Brandon Thomas
c81e6af507
fix codegen script
2023-03-18 01:35:40 -04:00
Brandon Thomas
98d30917e5
rename crate 'database_queries' -> 'mysql_queries' because sqlite
2023-03-18 01:19:15 -04:00
Brandon Thomas
e62e409857
refactor package directory structure
2023-03-18 01:11:10 -04:00
Brandon Thomas
417137a9a8
deprecate some crates
2023-03-18 01:07:01 -04:00
Brandon Thomas
0da1994f0c
101soundboards user tokens
2023-03-18 00:45:33 -04:00
Brandon Thomas
36d016c3c7
todo
2023-03-17 09:34:58 -04:00
Brandon Thomas
b22e978e54
cleanup tts authorization logic
2023-03-17 08:52:04 -04:00
Brandon Thomas
c387f47c97
(untested) disallow use of private models unless owner
2023-03-17 08:34:15 -04:00
Brandon Thomas
1a09676327
codegen db
2023-03-17 07:57:50 -04:00
Brandon Thomas
e516f85e5f
filter out models that are private/hidden
2023-03-17 07:54:57 -04:00
Brandon Thomas
e16b86d36e
analytics query for non-public tts models
2023-03-17 06:50:06 -04:00
Brandon Thomas
003a86cd31
delete comments
2023-03-17 06:42:04 -04:00
Brandon Thomas
ebf48e20be
list comments endpoint
2023-03-16 12:21:28 -04:00
Brandon Thomas
df2444ddc0
insert comment
2023-03-16 11:09:26 -04:00
Brandon Thomas
6b6a2ceeba
codegen
2023-03-16 10:42:46 -04:00
Brandon Thomas
80da0d9649
Add tts result audio path to result endpoint
2023-03-16 10:31:28 -04:00
Brandon Thomas
b8fd0486c7
Untested query for inserting audit log items
2023-03-16 10:25:47 -04:00
Brandon Thomas
12ffb2ded1
new token types: comments, audit logs
2023-03-16 09:36:13 -04:00
Brandon Thomas
f810256b9c
new table enums
2023-03-16 09:28:49 -04:00
Brandon Thomas
461030b681
new tables (WIP) for comments + voice survey
2023-03-16 09:03:56 -04:00
Brandon Thomas
a33ff3f060
20 trending english voices
2023-03-16 09:02:43 -04:00
Brandon Thomas
98736324dc
25 trending english voices
2023-03-16 09:01:57 -04:00
Brandon Thomas
89a6f36f1a
gitignore for windows
2023-03-13 20:33:31 -04:00
Brandon Thomas
ac5bcbdd16
aichatbot: handler for current level
2023-03-13 18:27:25 -04:00
Brandon Thomas
7566c0d71c
use strum and default for more maintainable options
2023-03-13 18:20:58 -04:00
Brandon Thomas
0ca007b6e7
add level option for AiChatbotSidecar
2023-03-13 18:09:28 -04:00
Brandon Thomas
cbe07e2b3e
move test function out of aichatbot-sidecar
2023-03-13 17:50:04 -04:00
Brandon Thomas
495c01c38c
Merge pull request #40 from storytold/bt-cache-session
...
cache sessions + purge cache on billing, edit profile, etc.
2023-03-12 05:19:28 -04:00