InternLM

Model Details

Creator

SenseTime & Shanghai AI Laboratory (equal contribution)

URL

https://github.com/InternLM/InternLM-techreport

Model Description

We present InternLM, a multilingual foundational language model with 104B parameters. InternLM is pre-trained on a large corpora with 1.65T tokens with a multi-phase progressive process, and then fine-tuned to align with human preferences. The evaluation on a number of benchmarks shows that InternLM achieves state-of-the-art performance in multiple aspects, including knowledge understanding, reading comprehension, reasoning, mathematics, and coding. With such well-rounded capabilities, InternLM achieves outstanding performances on comprehensive exams, including MMLU, AGIEval, and C-Eval, without resorting to external tools. It is noteworthy that InternLM even competes with GPT-4 in certain aspects. Also, InternLM demonstrates excellent capability of understanding Chinese language and Chinese culture, which makes it a suitable foundation model to support Chinese-oriented language applications.

Prompt Format

Few-shot

Detail Results

Here is a detailed breakdown of the results of this model across 52 different subjects, presented in sortable tables and bar graphs.
Among them, STEM contains 20 subjects, social sciences contains 10 subjects, humanities also contains 11 subjects, and other contains 11 subjects.

Sortable table:

Super Category Subject Accuracy
STEMComputer Network59.1
STEMOperating System59.8
STEMComputer Architecture62.7
STEMCollege Programming53.5
STEMCollege Physics37.5
STEMCollege Chemistry44.6
STEMAdvanced Mathematics39.3
STEMProbability and Statistics33.1
STEMDiscrete Mathematics43.8
STEMElectrical Engineer40.7
STEMMetrology Engineer65.3
STEMHigh School Mathematics34.9
STEMHigh School Physics66.3
STEMHigh School Chemistry68
STEMHigh School Biology76.6
STEMMiddle School Mathematics57.1
STEMMiddle School Biology89.1
STEMMiddle School Physics82.6
STEMMiddle School Chemistry90.3
STEMVeterinary Medicine57.6
Social ScienceCollege Economics52.5
Social ScienceBusiness Administration54.2
Social ScienceMarxism85.5
Social ScienceMao Zedong Thought80.4
Social ScienceEducation Science65.9
Social ScienceTeacher Qualification84.2
Social ScienceHigh School Politics85.2
Social ScienceHigh School Geography77.5
Social ScienceMiddle School Politics93.3
Social ScienceMiddle School Geography88
HumanitiesModern Chinese History72.6
HumanitiesIdeological and Moral Cultivation82.6
HumanitiesLogic48
HumanitiesLaw50.7
HumanitiesChinese Language and Literature58.9
HumanitiesArt Studies63.4
HumanitiesProfessional Tour Guide67.3
HumanitiesLegal Professional46.5
HumanitiesHigh School Chinese53.4
HumanitiesHigh School History78
HumanitiesMiddle School History88.9
OtherCivil Servant62
OtherSports Science60
OtherPlant Protection64.8
OtherBasic Medicine56.6
OtherClinical Medicine54.5
OtherUrban and Rural Planner58.4
OtherAccountant56.9
OtherFire Engineer40.4
OtherEnvironmental Impact Assessment Engineer57.7
OtherTax Accountant48.8
OtherPhysician60.5

Bar graph: