PLLuM: Polish Language Models for State Digitalization

Polish language models PLLuM (Polish Large Language Model) are a groundbreaking project by the Ministry of Digital Affairs, introducing artificial intelligence tailored to our linguistic and cultural realities. Created by Polish experts, these models process and generate Polish texts with extraordinary precision, handling inflection and complex syntax. Thanks to them, Poland gains independence in the field of AI, supporting the digitalization of the state.

What is PLLuM and how was it created?

PLLuM is a family of language models, ranging from 8 to 70 billion parameters, trained on Polish data by a scientific consortium. The project involved: Wrocław University of Technology, NASK, Institute of Mathematics of the Polish Academy of Sciences, Information Processing Center – National Research Institute (OPI-PIB), University of Łódź, and the Institute of Slavic Studies of the Polish Academy of Sciences. The models are developed on behalf of the Ministry of Digital Affairs, with the support of infrastructure such as the Helios supercomputer at Cyfronet AGH.

The process of creating PLLuM is distinguished by the quality of data – it mainly uses organic data, manually processed, without being generated by other AI models. This ensures higher precision in understanding the Polish socio-cultural and official context. Smaller variants are suitable for quick tasks, while larger ones offer deeper analysis and consistency.

The project was successfully completed, and the models are openly available to everyone on the website pllum.org.pl. The Ministry has already invested 14.5 million PLN, with another 19 million PLN allocated for implementations and expanding cooperation.

Why does Poland need its own AI models?

Most global language models, like GPT, are mainly trained on English data. This causes problems with Polish inflection, idioms, or cultural context. PLLuM addresses these issues, offering technological sovereignty: local deployment, data control, and licensing independence.

"PLLuM is proof that we can develop modern technologies on our own terms, in our language, for the benefit of citizens." – Krzysztof Gawkowski, Deputy Prime Minister and Minister of Digital Affairs.

The development of national AI competencies is also an investment in security and innovation. As Deputy Minister Dariusz Standerski emphasizes: “Thanks to such projects, we add an element of technological sovereignty to Poland.”

Applications of PLLuM in public administration

PLLuM is set to revolutionize the digitalization of the state. Key implementations include:

• Virtual assistant in mCitizen: Facilitates citizens' access to public information and administrative services.
• Intelligent clerical assistant: Automates document processing, content analysis, information search, and answering questions.

The Information Processing Center (COI) is responsible for integration with official tools, and Cyfronet provides computing power. This will accelerate digital transformation, making administration more efficient.

PLLuM beyond administration: business, education, and everyday life

PLLuM models extend beyond the public sector. In business, they support innovation by generating content tailored to the Polish market. In education, they can serve as tools for language learning or creating educational materials. Private users gain free, local access to precise AI.

Example applications:

1. Generating reports and analyses in Polish.
2. Specialized translation considering industry terminology.
3. Creating chatbots for companies serving customers in Polish.
4. Assistance in writing petitions or official applications.

Thanks to open-source code, developers can modify it, creating new applications.

The future of PLLuM and the AI ecosystem in Poland

The Ministry of Digital Affairs plans further development: new versions of models, broader partnerships, and integrations. The project complements other initiatives, like Bielik, building a national AI ecosystem. A new version of PLLuM is already available, confirming dynamic progress.

Challenges? Scalability and continuous data improvement. However, with investments of tens of millions of PLN, Poland positions itself as a leader in the region.

Summing up the PLLuM revolution

PLLuM is not just technology – it's a step towards a digital state where AI speaks Polish and understands our needs. Available to everyone, open and sovereign, it changes the face of administration, business, and education. We encourage experimenting with the model at pllum.org.pl and following further implementations.

The project proves that Polish science and administration can create world-class AI. It's time for the Polish era of artificial intelligence!