granite3.1-dense

The IBM Granite 2B and 8B models are text-only dense LLMs trained on over 12 trillion tokens of data, demonstrated significant improvements over their predecessors in performance and speed in IBM’s initial testing.

tools 2b 8b

87.4K 2 months ago

33 Tags
latest
34d3be74ec54 • 5.0GB • 2 months ago
2b
fba1ad01113e • 1.6GB • 2 months ago
8b
34d3be74ec54 • 5.0GB • 2 months ago
2b-instruct-fp16
1f64b4541957 • 5.1GB • 3 months ago
2b-instruct-q2_K
f412eb659c66 • 1.0GB • 2 months ago
2b-instruct-q3_K_L
85ad99cb9a18 • 1.4GB • 2 months ago
2b-instruct-q3_K_M
d65eb61a1e65 • 1.3GB • 2 months ago
2b-instruct-q3_K_S
74791f52899c • 1.2GB • 2 months ago
2b-instruct-q4_0
7ed050a70760 • 1.5GB • 2 months ago
2b-instruct-q4_1
c265a649f4f8 • 1.6GB • 2 months ago
2b-instruct-q4_K_M
fba1ad01113e • 1.6GB • 2 months ago
2b-instruct-q4_K_S
a8d7602ade5f • 1.5GB • 2 months ago
2b-instruct-q5_0
f26890da1451 • 1.8GB • 2 months ago
2b-instruct-q5_1
35c067239cb5 • 1.9GB • 2 months ago
2b-instruct-q5_K_M
86cdcdb94cd6 • 1.8GB • 2 months ago
2b-instruct-q5_K_S
1a2b39f6e69c • 1.8GB • 2 months ago
2b-instruct-q6_K
66d07595e1dc • 2.1GB • 2 months ago
2b-instruct-q8_0
ef1441680161 • 2.7GB • 3 months ago
8b-instruct-fp16
51d4ae6e2b23 • 16GB • 3 months ago
8b-instruct-q2_K
4b18119a5086 • 3.2GB • 2 months ago
8b-instruct-q3_K_L
8f28ec28aafc • 4.4GB • 2 months ago
8b-instruct-q3_K_M
0dc5c3ac8a1e • 4.0GB • 2 months ago
8b-instruct-q3_K_S
338340c340cb • 3.6GB • 2 months ago
8b-instruct-q4_0
fc2c18155205 • 4.7GB • 2 months ago
8b-instruct-q4_1
a94882d992cf • 5.2GB • 2 months ago
8b-instruct-q4_K_M
34d3be74ec54 • 5.0GB • 2 months ago
8b-instruct-q4_K_S
4707086b3bed • 4.7GB • 2 months ago
8b-instruct-q5_0
3ec7544ebcb8 • 5.7GB • 2 months ago
8b-instruct-q5_1
5f3faea362a7 • 6.2GB • 2 months ago
8b-instruct-q5_K_M
4ae40e965ca7 • 5.8GB • 2 months ago
8b-instruct-q5_K_S
8c98cd3dd70e • 5.7GB • 2 months ago
8b-instruct-q6_K
8e5691d17175 • 6.8GB • 2 months ago
8b-instruct-q8_0
fd5499afc361 • 8.7GB • 3 months ago