Firworks's picture

22 87

Firworks

Firworks

·

firworksyt

AI & ML interests

Local Inference, Fine Tunes, & NVFP4 Quantization

Recent Activity

updated a model about 3 hours ago

Firworks/GLM-4.5-Air-REAP-82B-A12B-nvfp4

new activity about 3 hours ago

Firworks/GLM-4.5-Air-REAP-82B-A12B-nvfp4:“I am unable to start this model using vllm serve on the RTX 5090.”

updated a model about 13 hours ago

Firworks/Cydonia-24B-v4.3-nvfp4

View all activity

Organizations

None yet

New activity in Firworks/GLM-4.5-Air-REAP-82B-A12B-nvfp4 about 3 hours ago

“I am unable to start this model using vllm serve on the RTX 5090.”

#1 opened 6 days ago by

New activity in Firworks/Hermes-4.3-36B-nvfp4 1 day ago

Nice!

#1 opened 3 days ago by

New activity in Firworks/KAT-Dev-72B-Exp-nvfp4 5 days ago

How did you quantize it?

#1 opened 5 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 5 days ago

Request quantization model

#6 opened 7 days ago by

New activity in Firworks/MiroThinker-v1.0-30B-nvfp4 6 days ago

Request quantization of VLM

#2 opened 15 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 7 days ago

cost estimates?

#5 opened 7 days ago by

is NVFP4 supported on sm120 (blackwell rtx pro 6000, rtx 5090 etc)?

#4 opened 8 days ago by

New activity in Firworks/GLM-4.5-Air-nvfp4 8 days ago

not working at DGX Spark

#1 opened 11 days ago by

New activity in Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 8 days ago

quant script

#7 opened 8 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 9 days ago

Minimax

#3 opened 9 days ago by

New activity in stepfun-ai/Step-Audio-R1 9 days ago

Feedback and Missing File

#1 opened 9 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 11 days ago

Can you redece the size from 62 GB to about 35-40 GB range in 4bit or lesser?

#1 opened 11 days ago by

works with vLLM, with FLASHINFER_MOE_FP4

#2 opened 11 days ago by

New activity in Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 12 days ago

How many tokens/s are you seeing on those two 6000 Blackwell's?

#6 opened 13 days ago by

New activity in Firworks/MiroThinker-v1.0-30B-nvfp4 13 days ago

Good Job man!

#1 opened 16 days ago by

New activity in ArliAI/GLM-4.5-Air-Derestricted 13 days ago

Request nvfp4 quantization

#2 opened 15 days ago by

New activity in TheDrummer/Precog-123B-v1 24 days ago

Good Idea

#1 opened 24 days ago by

New activity in Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 25 days ago

error on spark

#4 opened 29 days ago by

Looks like moonshot updated base repo

#5 opened 26 days ago by

New activity in Firworks/Valkyrie-49B-v2-nvfp4 about 1 month ago

thanks for doing these fp4 quants

#1 opened about 1 month ago by