A look back at an innovative day of exciting discussions at the IFA Campus Marcel Sauvage.

A few days ago, Michel-Marie MAUDET, Managing Director and co-founder of LINAGORA, took part in the 8th Pedagogical Innovation Day of the Institut de Formations Alternances at the Marcel SAUVAGE Campus.

After a brief introduction by our Chairman Alexandre ZAPOLSKY, Michel-Marie presented the progress made in training LUCIE, the 1st truly Open Source Generative AI model developed by the OpenLLM France/Europe community.

Here's what's new:

Pre-training completed over a week ago;

Extension of the pop-up window from 4k to 32k, with completion scheduled for early this week;

Annealing phase: 2 weeks to produce the basic foundation model...

The anneling phase is a stage in model training inspired by the simulated annealing process in physics. The aim of this technique is to progressively adjust certain parameters of the model in order to improve its stability and performance.

The appraisal phase, scheduled for mid-December, will enable LUCIE to operate as a RAG (questions and answers);

This step was illustrated by Andrzej NEUGEBAUER, AI Program Director at LINAGORA, during his workshop on the RAG to help teachers prepare and generate their teaching sequences.

Publication of the model with its dataset, source code and model files available on Hugging Face for testing.

See the presentation

Watch the REPLAY of the OpenLLM Webinar