Skip to content
Snippets Groups Projects
Commit 254bad10 authored by Yoann Schneider's avatar Yoann Schneider :tennis: Committed by Erwan Rouchet
Browse files

Remove training process mentions

parent 99b285ed
No related branches found
No related tags found
1 merge request!102Remove training process mentions
Pipeline #158443 passed
+++
title = "Train a Machine Learning model"
description = "Use Arkindex to train a Machine Learning model"
weight = 50
+++
You can use Arkindex to train machine learning models for Arkindex's workers, using annotated data from any Arkindex project you have access to. There must be within this project **at least one folder**: the folder containing the training data.
You can also use optional validation and test folders.
To start a training process for a given Model, on a given Project, you need a **contributor** access to the Project, and an **admin** access to the Model.
The training interface can be accessed from the **Actions** dropdown menu on the right of the header of a project.
{{ figure(image="howto/train_model/actions_train.png", height=260, caption="'Train a model' in the Actions menu") }}
## The training interface
In order to train a Machine Learning model, you have to set a number of parameters in the training process configuration form.
{{ figure(image="howto/train_model/training_form.png", height=600, caption="The training process configuration form") }}
### Naming your training process
First, you have to name your training process. This will be useful to find it again in the processes list, if you navigate away from the process status page.
### Selecting a worker version
Then, you need to select the worker version that will perform the training. For example, if you want to train a model for Doc-UFCN, you need to select the latest available version for this worker in the worker version selection modal. The trained model, once it's finished training, will be available to be used in Machine Learning processes using this worker.
{{ figure(image="howto/train_model/version_picker.png", height=500, caption="Worker version selection") }}
### Configuring the training process
You can (optionnally) add a training configuration to your training process. You can either select an existing configuration, or create a new configuration, using the configuration modal.
{{ figure(image="howto/train_model/training_config.png", height=350, caption="Training configuration") }}
### Selecting a model to train
You have to select the model you will be training, among the available models. You can also, optionally, select a model version to start your training from.
{{ figure(image="howto/train_model/model_selection.png", height=500, caption="Model selection modal") }}
### Training, validation and test folders
You have to select a training folder, containing the data you want to train your model on, from the existing folders in the corpus you've chosen to train a model on. You can also select a validation and a test folder.
{{ figure(image="howto/train_model/folder_picker.png", height=350, caption="Folder picker modal") }}
The data contained in the training and validation folders is used to train the model, while the data contained is the test folder is never used during the traing process, and only serves to test it on totally new data to evaluate its performance.
### GPU usage
Lastly, you can chose to use GPU or not to train your model, using the GPU toggle.
You can then click the **Start training** button.
## Training Process Status
This takes you to a process status page, similar to the one with which you can follow the process of a Workers workflow. You can leave this status page, and find it again in the Processes List (`/process`). This list can be filtered with various parameters, including the process name, so you can easily find your training process again and monitor it.
Once the training has been successfully completed, you new model is available to use in [Machine Learning Processes](../run-process/).
......@@ -46,13 +46,13 @@ Please refer to [manage a group](@/users/groups/index.md#manage-a-group) section
#### Group permission table
| action | no right | guest | contributor | admin |
|---------------------------------|----------|-------|-------------|--------|
| List members of a public group | ❌ | ✅ | ✅ | ✅ |
| List members of a private group | ❌ | ✅ | ✅ | ✅ |
| Leave a group | ❌ | ✅ | ✅ | ✅ |
| Delete a group | ❌ | ❌ | ❌ | ✅ |
| Manage members of a group | ❌ | ❌ | ❌ | ✅ |
| action | no right | guest | contributor | admin |
| ------------------------------- | -------- | ----- | ----------- | ----- |
| List members of a public group | ❌ | ✅ | ✅ | ✅ |
| List members of a private group | ❌ | ✅ | ✅ | ✅ |
| Leave a group | ❌ | ✅ | ✅ | ✅ |
| Delete a group | ❌ | ❌ | ❌ | ✅ |
| Manage members of a group | ❌ | ❌ | ❌ | ✅ |
### Project access
......@@ -77,19 +77,19 @@ Please note that as for other resources, at least one user or group must have an
#### Project permission table
| action | no right | guest | contributor | admin |
|-----------------------------------------------------|----------|-------|-------------|--------|
| Navigate in public projects | ✅ | ✅ | ✅ | ✅ |
| Navigate in private projects | ❌ | ✅ | ✅ | ✅ |
| Download an existing export | ❌ | ✅ | ✅ | ✅ |
| Generate an export | ❌ | ❌ | ✅ | ✅ |
| Import new elements (from files or IIIF paths) | ❌ | ❌ | ✅ | ✅ |
| Create annotations | ❌ | ❌ | ✅ | ✅ |
| Create a transcription/class/metadata on an element | ❌ | ❌ | ✅ | ✅ |
| Manage members | ❌ | ❌ | ❌ | ✅ |
| Delete elements | ❌ | ❌ | ❌ | ✅ |
| Start a Machine Learning process | ❌ | ❌ | ❌ | ✅ |
| Start a Machine Learning Training process | ❌ | ❌ | | ✅ |
| action | no right | guest | contributor | admin |
| --------------------------------------------------- | -------- | ----- | ----------- | ----- |
| Navigate in public projects | ✅ | ✅ | ✅ | ✅ |
| Navigate in private projects | ❌ | ✅ | ✅ | ✅ |
| Download an existing export | ❌ | ✅ | ✅ | ✅ |
| Generate an export | ❌ | ❌ | ✅ | ✅ |
| Import new elements (from files or IIIF paths) | ❌ | ❌ | ✅ | ✅ |
| Create annotations | ❌ | ❌ | ✅ | ✅ |
| Create a transcription/class/metadata on an element | ❌ | ❌ | ✅ | ✅ |
| Manage members | ❌ | ❌ | ❌ | ✅ |
| Delete elements | ❌ | ❌ | ❌ | ✅ |
| Start a process | ❌ | ❌ | ❌ | ✅ |
| Start a dataset process | ❌ | ❌ | | ✅ |
### Repository access
......@@ -105,11 +105,11 @@ An access given to a repository will automatically grant the same access to all
#### Repository permission table
| action | no right | guest | contributor | admin |
|-----------------------|----------|-------|-------------|--------|
| Retrieve a repository | ❌ | ✅ | ✅ | ✅ |
| Delete a repository | ❌ | ❌ | ❌ | ✅ |
| Manage members | ❌ | ❌ | ❌ | ✅ |
| action | no right | guest | contributor | admin |
| --------------------- | -------- | ----- | ----------- | ----- |
| Retrieve a repository | ❌ | ✅ | ✅ | ✅ |
| Delete a repository | ❌ | ❌ | ❌ | ✅ |
| Manage members | ❌ | ❌ | ❌ | ✅ |
### Worker access
......@@ -135,13 +135,13 @@ A Guest role has no meaning for workers as a Contributor role is required to lis
{% end %}
| action | no right | guest | contributor | admin |
|--------------------------------------------------------------------------------|----------|-------|-------------|-------|
| Lookup the worker that created a resource (e.g. element, class, transcription) | ✅ | ✅ | ✅ | ✅ |
| List workers | ❌ | ❌ | ✅ | ✅ |
| List versions associated to a worker | ❌ | ❌ | ✅ | ✅ |
| Run a Machine Learning workflow with a worker | ❌ | ❌ | ✅ | ✅ |
| Delete a worker | ❌ | ❌ | ❌ | ✅ |
| Manage members | ❌ | ❌ | ❌ | ✅ |
| ------------------------------------------------------------------------------ | -------- | ----- | ----------- | ----- |
| Lookup the worker that created a resource (e.g. element, class, transcription) | ✅ | ✅ | ✅ | ✅ |
| List workers | ❌ | ❌ | ✅ | ✅ |
| List versions associated to a worker | ❌ | ❌ | ✅ | ✅ |
| Run a process with a worker | ❌ | ❌ | ✅ | ✅ |
| Delete a worker | ❌ | ❌ | ❌ | ✅ |
| Manage members | ❌ | ❌ | ❌ | ✅ |
### Processes access
......@@ -151,12 +151,12 @@ A user may track the progress of a visible process, with its tasks artifacts.
#### Processes permission table
| action | no right | guest | contributor | admin |
|--------------------------------------|----------|-------|-------------|--------|
| See a process | ❌ | ✅ | ✅ | ✅ |
| Configure and start a process | ❌ | ❌ | ❌ | ✅ |
| Stop a running process | ❌ | ❌ | ❌ | ✅ |
| Retry a failed process | ❌ | ❌ | ❌ | ✅ |
| action | no right | guest | contributor | admin |
| ----------------------------- | -------- | ----- | ----------- | ----- |
| See a process | ❌ | ✅ | ✅ | ✅ |
| Configure and start a process | ❌ | ❌ | ❌ | ✅ |
| Stop a running process | ❌ | ❌ | ❌ | ✅ |
| Retry a failed process | ❌ | ❌ | ❌ | ✅ |
### Models access
......@@ -164,25 +164,25 @@ A user can see the Machine Learning models they have access to from **My models*
Guests can only see available versions with a set tag while contributors (or admins) can see all of them.
If you have admin rights on the model, you can delete its versions and manage its rights. You can also create a new model version by creating a [training process](../../howto/train-model/) for this Model.
If you have admin rights on the model, you can delete its versions and manage its rights.
{{ figure(image="users/rights/models-list.png", height=330, caption="Models management page") }}
#### Models permission table
| action | no right | guest | contributor | admin |
|--------------------------------------|----------|-------|-------------|--------|
| See a model | ❌ | ✅ | ✅ | ✅ |
| List its available versions (with a set tag) | ❌ | ✅ | ✅ | ✅ |
| List its versions | ❌ | ❌ | ✅ | ✅ |
| Delete a version | ❌ | ❌ | ❌ | ✅ |
| Manage members | ❌ | ❌ | ❌ | ✅ |
#### Training processes permission table
| action | no right | guest | contributor | admin |
|-----------------------------------------------|----------|-------|-------------|--------|
| See a training process | ❌ | ✅ | ✅ | ✅ |
| Configure and start a training process | ❌ | ❌ | ❌ | ✅ |
| Stop a running training process | ❌ | ❌ | ❌ | ✅ |
| Retry a failed training process | ❌ | ❌ | ❌ | ✅ |
| action | no right | guest | contributor | admin |
| -------------------------------------------- | -------- | ----- | ----------- | ----- |
| See a model | ❌ | ✅ | ✅ | ✅ |
| List its available versions (with a set tag) | ❌ | ✅ | ✅ | ✅ |
| List its versions | ❌ | ❌ | ✅ | ✅ |
| Delete a version | ❌ | ❌ | ❌ | ✅ |
| Manage members | ❌ | ❌ | ❌ | ✅ |
#### Dataset processes permission table
| action | no right | guest | contributor | admin |
| ------------------------------------- | -------- | ----- | ----------- | ----- |
| See a dataset process | ❌ | ✅ | ✅ | ✅ |
| Configure and start a dataset process | ❌ | ❌ | ❌ | ✅ |
| Stop a running dataset process | ❌ | ❌ | ❌ | ✅ |
| Retry a failed dataset process | ❌ | ❌ | ❌ | ✅ |
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment