!zghijEASpYQWYFzriI:nixos.org

Hydra

385 Members
109 Servers

Load older messages


SenderMessageTime
2 Aug 2023
* @raitobezarius:matrix.orgraitobezarius
In reply to @janne.hess:helsinki-systems.de
I think a good concept to replace the web thingie would be to write an API server and call that api from the current web pages. This way we can port feature after feature and end up with a CSR application and a new API that is more complete than the current one
nods
18:09:38
@janne.hess:helsinki-systems.dedas_j(replacing perl with nginx in the end) 18:09:42
@raitobezarius:matrix.orgraitobezarius
In reply to @k900:conduit.0upti.me
Like I'm expecting the fast way of doing things to be some select-for-update nonsense
the biggest problem I have identified IMHO is the builds table
18:09:54
@raitobezarius:matrix.orgraitobezarius and I think the trivial solution is just to partition it 18:10:02
@raitobezarius:matrix.orgraitobezarius
Planning Time: 1.121 ms
 JIT:
   Functions: 20
   Options: Inlining true, Optimization true, Expressions true, Deforming true
   Timing: Generation 11.320 ms, Inlining 1887.909 ms, Optimization 239.903 ms, Emission 327.814 ms, Total 2466.946 ms
 Execution Time: 39210.169 ms
18:10:22
@janne.hess:helsinki-systems.dedas_jWe talked about that and I have no valuable input as my knowledge about that isn't too good18:10:27
@raitobezarius:matrix.orgraitobezarius here's the cost of a explain analyze select count(*) from builds; 18:10:30
@raitobezarius:matrix.orgraitobezarius
In reply to @janne.hess:helsinki-systems.de
We talked about that and I have no valuable input as my knowledge about that isn't too good
we need to decide on the partition key
18:10:38
@raitobezarius:matrix.orgraitobezariuseither IDs or dates18:10:41
@raitobezarius:matrix.orgraitobezariusor whatever locally makes sense18:10:45
@raitobezarius:matrix.orgraitobezariusand we don't have to lock a choice, we can just try things18:10:53
@k900:conduit.0upti.meK900 (deprecated)Wait what is it even doing, a full scan?18:11:22
@raitobezarius:matrix.orgraitobezariusbut database design is indeed another separate concern from the web part, etc.18:11:24
@raitobezarius:matrix.orgraitobezarius
In reply to @k900:conduit.0upti.me
Wait what is it even doing, a full scan?
lol
18:11:28
@raitobezarius:matrix.orgraitobezariusare you ready?18:11:29
@raitobezarius:matrix.orgraitobezarius
Finalize Aggregate  (cost=1666154.70..1666154.71 rows=1 width=8) (actual time=39057.027..39207.028 rows=1 loops=1)
   ->  Gather  (cost=1666153.87..1666154.68 rows=8 width=8) (actual time=39047.839..39206.943 rows=9 loops=1)
         Workers Planned: 8
         Workers Launched: 8
         ->  Partial Aggregate  (cost=1665153.87..1665153.88 rows=1 width=8) (actual time=38801.196..38801.202 rows=1 loops=9)
               ->  Parallel Index Only Scan using indexbuildsontimestamp on builds  (cost=0.57..1596964.67 rows=27275678 width=0) (actual time=0.445..37043.934 rows=24248822 loops=9)
                     Heap Fetches: 0
18:11:37
@k900:conduit.0upti.meK900 (deprecated)Cause like just truncate the sodding thing WHAT18:11:42
@raitobezarius:matrix.orgraitobezariusyes exactly my reaction18:11:51
@k900:conduit.0upti.meK900 (deprecated)A 30 seconds index scan?18:11:56
@raitobezarius:matrix.orgraitobezarius parallel index scan sir 18:12:05
@raitobezarius:matrix.orgraitobezarius with JIT and 8 workers 18:12:10
@raitobezarius:matrix.orgraitobezariuson fucking 1M read IOPS NVMe18:12:17
@raitobezarius:matrix.orgraitobezariusjust to be clear18:12:19
@k900:conduit.0upti.meK900 (deprecated)imma go get drunk18:12:20
@raitobezarius:matrix.orgraitobezarius:'DDDDDDDDDD18:12:24
3 Aug 2023
@lotte:chir.rs@lotte:chir.rs changed their profile picture.12:48:23
4 Aug 2023
@linus:schreibt.jetzt@linus:schreibt.jetzthttps://github.com/NixOS/hydra/pull/129613:57:33
@ma27:nicht-so.sexyma27
In reply to @raitobezarius:matrix.org
hahhaha it's such a shame you were not here in Munich when das_j presented us with
regarding gems in hydra, my favorite one is still https://github.com/NixOS/hydra/blob/60e2c377d305b72cee39c51b5892d215e4238278/src/script/hydra-eval-jobset#L47-L61 %)
16:57:45
5 Aug 2023
@alfurqani:matrix.orgalfurqani joined the room.22:45:38
6 Aug 2023
@thobys:inpt.fr@thobys:inpt.fr changed their display name from Simon Thoby to nighmared.13:09:37

Show newer messages


Back to Room ListRoom Version: 6