This page is a tutorial page for those who want to take advantage of the features of nizima LIVE.
We will introduce each operation procedure according to the purpose.
Please see the nizima LIVE screen description for the explanation of each function along the screen.
Contents
How to connect to iPhone (nizima LIVE TRACKER)
How to register and edit expressions/edit custom models
How to set parameters for Live2D model
How to use the collaboration function
Let’s link nizima LIVE and distribution software
How to add a Live2D model
You need the embedded Live2D model data to load anew.
Find it on the official Live2D market nizima or create your own using the Live2D Cubism Editor.
1. Click “Model List” from the menu on the left side of the main window.
2. The model list window opens on nizima LIVE.
3. Click the “+” button.
4. Select the Live2D model file you prepared in advance (format: .model3.json) and click “Change”.
5. The imported Live2D model will be added to the model list.
The icon of the Live2D model is displayed by selecting ico_xxx.png from a certain hierarchy of .model3.json. If not, it will be the “NO IMAGE” icon.
6. select the added model (1) and click “Modify” (2) (or “Open in new window” or “Add to same window”).
Open in new window
Opens the selected Live2D model in a new window. Use this function when you want to display two or more Live2D models or when you want to use the collaboration function.
Add to the same window
Add the currently selected Live2D model to the current window. The model will be displayed to the right of the currently displayed model, approximately the same size as the first model. Up to 8 models can be displayed.
change
Opens the currently selected Live2D model in the current window. If a Live2D model is already displayed, the Live2D model will be changed; this is recommended when you want to display only one Live2D model.
7. The Live2D model you added is displayed.
How to register an item
1. click on “Item List” from the menu on the left side of the main window.
2. The Item List window will open.
3. Scroll and click the “+ button” at the bottom of the screen.
4. select the file of the previously prepared item and click “Open”.
List of Supported Formats by Item
| Item Type | Supported Formats |
|---|---|
| Live2D Items | model3.json |
| Animation Items | gif, sequentially numbered png folder, sequentially numbered jpeg folder (png or jpeg files that you want to play back in sequence in one folder) |
| Still Image Items | png, jpeg |
5. The loaded item is added to the item list.
How to place items
1. click on “Item List” from the menu on the left side of the main window.
2. The Item List window will open.
3. Select the item you wish to place (1) and click “Place Item (2)”.
4. The item operation window opens and the item is placed in the main window.
5. For details on how to operate items in the main window, please refer to Model Item Operations, and for details on how to operate items in the Item Operations window, please refer to Item Operations.
How to connect to iPhone (nizima LIVE TRACKER)
When connecting wirelessly via Wi-Fi
1. Connect your PC and iPhone to the same Wi-Fi.
2. Open nizima LIVE (PC).
3. Open Camera Settings from the menu on the left side of the main window and click Mobile Settings.
4. The following window will be displayed on nizima LIVE (PC).
5. open nizima LIVE TRACKER on your iPhone with the above window displayed on nizima LIVE (PC).
6. Tap the Menu button in the lower right corner to display the menu.
7. Tap “PC Connection”.
8. The following screen will appear on the iPhone.
9. Enter the “Port” and “PC IP address” displayed on the nizima LIVE (PC) side into the nizima LIVE TRACKER (iPhone) side, respectively.
10. Tap “Connect via Wi-Fi”.
“Status” changes to “Sending tracking data”.
11. on nizima LIVE (PC), click “Connect”.
The connection is complete when the “Status” changes to “Connected”.
There are four statuses of nizima LIVE (PC) as follows.
Common causes of connection errors
- PC and iPhone are not connected to the same Wi-Fi
- Network settings are public (may be improved by changing to private)
- Security software is blocking the connection between PC and iPhone (may be improved by reviewing the settings of security software)
- Firewall is blocking the connection between PC and iPhone (may be improved by reviewing firewall settings)
- I can’t get an IP Address.
- There is a problem with the line, the line speed is slow
For wired connection via USB cable
1. Install iTunes on your PC.
2. Connect the iPhone to the PC with a USB cable.
3. open nizima LIVE TRACKER on your iPhone and tap the menu button in the lower right corner to display the menu.
4. tap “PC Connection” > “USB (beta)” tab > “Connect via USB The “Status” will change to “Sending tracking data”.
5. on nizima LIVE (PC), open “Camera Settings” from the menu on the left side of the main window and click “Mobile Connection” > “USB (beta version)” > “Connect via USB”.
The connection is complete when the “Status” changes to “Connected”.
There are four statuses of nizima LIVE (PC) as follows.
Common causes of connection errors
- Network settings are public (may be improved by changing to private)
- Security software is blocking the connection between PC and iPhone (may be improved by reviewing the settings of security software)
- Firewall is blocking the connection between PC and iPhone (may be improved by reviewing firewall settings)
- There is a problem with the line, the line speed is slow
- iTunes is not installed on the PC
How to take a screenshot
How to click a button to take a picture
1. click the screenshot function button in the lower right corner of the main window at the timing you wish to take the shot.
2. A screenshot will be taken and an image preview will be displayed. If all is well, click “Save”.
3. The image data is saved in the specified PC folder and “Image Saved” is displayed in the upper right corner of the screen.
How to shoot with shortcut keys
1. From the main window, click “Settings/Others” > “Options” > “Screenshot”, enter the shortcut key you wish to set and click “Save”.
Note: The F3 key is set by default.
2. Return to the main window and press the shortcut key set in step 1 at the timing you wish to shoot.
3. The image data is saved in the designated PC folder, and “Image saved” is displayed in the upper right corner of the screen.
How to open the image storage location
It can be opened in one of the following ways
– Click “Settings/Others” > “Options” > “Screenshots” > “Open Folder
– Click on the “Image Saved” text that appears in the upper right corner of the window after the image is taken.
How to set shortcut keys for expressions and motions
By setting a shortcut key, you can play facial expressions and motions just by pressing a specific key on the keyboard.
1. Click “Facial Expression / Motion” from the menu on the left.
2. A list of facial expressions and motions attached to the Live2D model will open.
Facial expressions and motions need to be created on Live2D Cubism.
3. Click the triangle to the right of the facial expression / motion for which you want to set a shortcut key to open it.
4. Enter the name you want to display on nizima LIVE in “Display name”.
5. In “Shortcut”, enter the shortcut key you want to assign to the opened facial expression / motion and click “Save”.
For example, if you want to set the model to play an angry expression when you press the “A” key, click the triangle to the right of the angry expression to open it, enter “angry” in the “display name”, and set it to “shortcut”. Type “A” to save.
How to register and edit expressions/edit custom models
Facial expressions can now be created and edited within nizimaLIVE.
This allows for easy customization of custom models and easy creation of expressions for users who do not normally create expressions in Cubism.
1. Click “Expression/Motion” from the menu on the left.
2.Select a button in the expression editing mode according to the application.
1.For new creation: Press the “Create New Expression/Edit New Custom Model” button.
2. for existing edits: Toggle open the details and press the “Edit Expression” button.
3. create any facial expression .
Check the parameters you wish to edit and set the values and calculation mode.
For eye opening/closing parameters, “multiply” is recommended to prevent half-eye movement.
For part switching, “Add” or “Overwrite” is recommended.
In most other cases, if you are not sure about the mode, just set it to “add” and you will be fine.
4. Specify when to switch facial expressions.
Set the fade in and fade out in milliseconds respectively.
1ms=0.001sec
If you want to quickly switch expressions quickly, such as custom switching of a custom model or switching parts, set the value to a smaller value, such as 0 to 100.
If you want to switch slowly, such as Cheak, set a larger value.
5.Save the expression file.
1.Create exp3.json as one of the following
- Create New
- Overwrite existing files
- Create with an alias
2. the model’s facial expressions are automatically added to the model at this time
How to set parameters for Live2D model
Motion magnification / smoothing settings (for beginners)
If you are a beginner, let’s set this up first! The Live2D model will move more smoothly.
1. Click Parameter Settings from the menu in the main window.
2. The parameter setting screen is displayed.
On the left side of the screen, the one surrounded by a square is a list of parameters that can be tracked on nizima LIVE. Below that, you can associate the parameters of the Live2D model corresponding to that movement. (It is automatically linked by default)
Movement setting beta (ARKit) is a tracking parameter for iOS only.
For example, in the screen above, “angle X” and “body rotation X” are linked to “left and right movement of the face”, so if you turn your face to the left and right, you can see the “angle X” and “body” of the Live2D model. You can move the “Rotation X”.
3. Select the parameter you want to adjust.
4. Adjust the “Motion Magnification” while moving in front of the camera and moving the Live2D model.
The closer it is to 0%, the less the Live2D model will move with respect to body movements.
The closer you get to 200%, the more the Live2D model will move with respect to your body movements.
5. Similarly, adjust the “smoothing” while moving the Live2D model.
The closer it is to 0, the more the body movement will be reflected in the model movement without correction.
The closer it is to 100, the slower the reaction will be, but it will integrate and correct small shaking of the body and move the model smoothly.
Curve Editor Settings (for intermediate and advanced users)
1. Perform steps 1 to 3 of “Motion magnification / smoothing settings (for beginners)“.
2. Edit the curve to see how the output changes in relation to the input. Edit by dragging the point you hit anywhere.
Points in the selected state are purple. The green dot on the waveform is the current value.
Click […] in the upper right corner of the curve editor to display the various operation buttons.
| operation | Contents |
|---|---|
| left click | mark with a point |
| right click | Delete points |
| Copy entire curve or ctrl+C | Copy the shape of the entire curve. |
| Paste the entire curve or ctrl+V | Paste the entire curve shape that you have copied. |
| undo or ctrl+Z | Return to operation. |
| redo or ctrl+Y or ctrl+Shift+Z | Redo the returned operation. |
| Show/hide default values | Shows/hides the default values of the parameters that the Live2D model has. |
| Enable/disable snapping | Toggles whether the point snaps to the grid, edge of the screen, etc. |
| reset | Initializes the edits and returns the curve shape to its initial value. |
| arrow key | Use the arrows up, down, left, and right to move points. |
With Linear, Step, Invert Step, Bezier at the bottom of the screen, you can select which type to connect to the point to the right of the selected point.
Linear: A straight line connects the selected point and the point to the right of it. The animation is constant and variable, with linear movements.
Step: The selected point and the point to the right of it are connected by a horizontal straight line that matches the numerical value of the selected point. The animation moves so that the previous and next pictures change in an instant.
Invert Step: The selected point and the point to the right of it are connected by a horizontal straight line that matches the value of the point to the right. The animation moves so that the previous and next pictures change in an instant.
Bezier: Select to display the purple Bezier handle. You can move it up, down, left and right by grasping the rounded part, and you can freely edit the shape of the curve.
Curve Editor Application Examples
Align the curves of the right and left eyes
1. Select “Left Eye Open/Close” from the tracking items on the left side of the panel.
2. While actually moving the model, adjust the left eye opening with the curve editor.
3. When adjustment is complete, click on “…” in the upper right corner of the Curve Editor and click on “Copy Entire Curve”. The curve shape of the left eye opening/closing has been copied.
4. Select “Right Eye Open/Close” from the tracking items on the left side of the panel.
5. Click “Paste Entire Curve” from “…” in the upper right corner of the Curve Editor. The curve shape of the left eye open/close is pasted, and the open/close adjustment of the right eye and the left eye is now the same.
Improve the model’s mouth puckering.
If the model’s mouth cracks open and closes when the mouth is completely closed or when the model shakes her head while the mouth is closed, the following procedure may help.
1. Select “Mouth Open/Close” under “13 lip-sync”.
2. In the Curve Editor, adjust the curve so that it looks like the following
Left-click to hit a single point and move it so that it is at the lowest vertical axis and 25% horizontal axis.
3. Actually move the model to see if it has been improved. Adjust the curves as necessary.
How to set up lip-sync
It can now be set to reflect mouth movements in response to voice rather than camera.
Lip-sync is a feature that allows Live2D models to move in response to audio input from a microphone.
It is mainly used for mouth movements in Live2D models.
Even when the camera cannot pick up mouth movements well, the lip-sync function can be used to achieve more precise movements.
How to use (easy)
1. turn on “Lip-sync support for ‘mouth’ and ‘mouth spread’”.
When the lip-sync function is enabled for the first time, it is automatically turned on.
This will allow the parameters tied to “13. mouth” and “14. mouth spread” in “Motion Settings” to be moved by “16. lip-sync (vertical)” and “17. lip-sync (horizontal)” without any settings on the user side.
2.Select the microphone to be used under “Input Device”.
3. while speaking, check the volume meter for the input threshold, and if it is low, adjust it with “Input Boost”.
4. from the “Sensitivity” auto-setup button, make settings according to the display.
*If you want to cut noise such as environmental noise, adjust the “Input threshold”. Any audio volume below the threshold will be ignored.
*Turn on “Use camera when input is below threshold” if you want to move the mouth with facial expressions when no audio is present, such as yawning or reaction without voice.
How to use (advanced)
If you want to make advanced settings, such as moving aiueo mouths created with blendshapes to match vowels or controlling parameters by volume, you can manually adjust parameter associations.
Here is an example of moving an Aiueo mouth created with a blendshape.
1. In the “Motion Settings” tab, unassociate the parameter you want to move for lip-sync from the tracking item currently associated with it by clicking the X button.
Example: Use the X button to unassociate the “A”, “I”, “U”, “E”, and “O” parameters associated with “13. mouth” and “14. mouth spread”.
2. Also in the “Movement Settings” tab, select the lip-sync item you wish to use and select the parameter you wish to link from the + button.
Example: Select the parameter “A” from the + button of “18. Lip Sync (A)” and press the Add button. The “A” movement of the Live2D model is now associated with the “18. Lip Sync (A)” movement. Set “19. Lip Sync (I)” and thereafter in the same way.
[How to use (easy)] Configure the settings in the same way as in 2. and thereafter.
How to use the collaboration function
To send and receive tracking data and Live2D model data of other users using the collaboration function, the host creates a “room” and participants enter the “room”.
How to create a room
1. Click “Collaboration Function”> “Create Room” from the menu on the left side of the main window.
2. The following screen is displayed.
If necessary, change the “User Name” displayed to the collaboration room participants.
If necessary, check the “Send Model Data” checkbox.
When “sending model data” (recommended)
If you check the “Send model data” checkbox, the data of the Live2D model currently being displayed will be sent to the participants, who will then be able to display your Live2D model.
The parameters of the currently displayed Live2D model will be sent, so you do not need to select the camera again in “Select Tracking”.
When not “Send model data”
If you do not check “Send model data”, only tracking data will be sent to participants (model data will not be sent).
Under Select Tracking, select the camera you want to use to send your tracking data.
Participants can receive tracking data by opening a new model window and selecting an arbitrary “user name” from “Collaboration Camera”.
If you have passed Live2D model data to the participants in advance, or if the participants do not need to display your Live2D model, proceed without checking.
3. When you have completed all the entries, click the “Create Room” button.
4. If the screen below is displayed, the collaboration room has been created successfully.
5. Copy the “Room ID” and send the “Room ID” to the participants separately to tell them to enter the collaboration room.
How to enter the room
1. Click “Collaboration Function”> “Enter Room” from the menu of the main window.
2. The following screen is displayed.
3. In Room ID, enter the room ID you received from the room creator separately.
If necessary, change the “User Name” displayed to the collaboration room participants.
If necessary, check “Send model data” and select the Live2D model to send.
When “sending model data” (recommended)
If you check the “Send model data” checkbox, the data of the Live2D model currently being displayed will be sent to the participants, who will then be able to display your Live2D model.
The parameters of the currently displayed Live2D model will be sent, so you do not need to select the camera again in “Select Tracking”.
When not “Send model data”
If you do not check “Send model data”, only tracking data will be sent to participants (model data will not be sent).
Under Select Tracking, select the camera you want to use to send your tracking data.
Participants can receive tracking data by opening a new model window and selecting an arbitrary “user name” from “Collaboration Camera”.
If you have passed Live2D model data to the participants in advance, or if the participants do not need to display your Live2D model, proceed without checking.
4. When you have completed all the entries, click the “Create Room” button.
5. When the following room screen is displayed, you have successfully entered the collaboration room.
How to display a Live2D model of a participant
In the collaboration room window, click “Same Window” to the right of the user name to display the Live2D model of the collaborator in the current window. Clicking on “Another Window” will open a new window and display the Live2D model of the collaborator.
How to assign participant movements to Live2D models in your app
1. Click “Model List” from the menu in the main window.
2. From the list of Live2D models, select the Live2D model to which you want to assign the participant’s movement and click “Add to same window” or “Open in new window”.
3. with the collaborator’s model selected, click “Camera Settings” from the main window menu and select the participant’s camera from “Collaboration Camera”.
Exit from the collaboration room
To exit the collaboration function, follow the steps below to leave the collaboration room.
If you are sending model data to other participants, your Live2D model window displayed by the participants will be closed when you leave the collaboration room.
1. Click Exit from Collaboration Room in the Collaboration Room window.
2. When the exit confirmation window is displayed, click “Exit”.
Make live streaming easier by fixing the window display to the front of the screen.
If you set the option Fix front row screen, nizima LIVE will be displayed in front of other applications.
Instead of creating layers in OBS, create a simple layer structure on the desktop and make the background transparent to make live streaming easier.
1. Select Transparent Background from Background Settings
2. Select “Window always on top” from Advanced Settings in Options.
Let’s link nizima LIVE and distribution software
To become a VTuber on a video distribution site such as Youtube using nizima LIVE, import the screen of nizima LIVE into distribution software such as OBS Studio and distribute it. Here, we will introduce how to display the Live2D model of nizima LIVE on the distribution software “OBS Studio”.
nizima LIVE offers a free plug-in for OBS. By using this plug-in, you can perform the following operations.
How to install OBS plugin (first time only)
1. Download OBS Studio from the OBS Studio official website.
2. Get the installer for the nizima LIVE OBS plug-in from the “Download OBS Plugin” button on the nizima LIVE download page.
3. Execute the downloaded “nizimalive-obsplugin-99.99.99-Windows-Installer.exe” (99.99.99 is the version name) to start the installer.
4. Select the language you want to use for setup and press [OK].
5. The terms of use are displayed. After confirming the contents, click [Next].
6. Specify the installation folder. If you are not particular about it, just click [Next].
7. A window will appear asking you to confirm the installation in the existing folder. Click [Yes] as it is.
8. Specify the Start Menu folder. If you are not particular about it, just click [Next].
9. Click [Install].
10. Click [Finish].
11. Start nizima LIVE and click [Settings / Others]> [Options].
12. Check the [OBSプラグインを有効にする]checkbox.
13. Restart nizima LIVE or reopen it in a new window.
How to display a Live2D model with transparent background using the OBS plugin
1. Open nizima LIVE and display the Live2D model you want to use for distribution from the “Model List”.
2. Set the background to transparent in “Background Settings”> “Transparent Background”> “Set as Background”.
3. In OBS Studio, click “+”> “nizima_LIVE” under “Source”.
4. The Create / Select Source window is displayed. If you want to display multiple models, change the name to model name etc. so that you can easily distinguish them, and click OK.
6. The property screen is displayed. Select the window of the Live2D model you want to display by “Window name” and click OK.
8. You have added a new source.
If you want to display multiple models in collaboration distribution etc., repeat the same operation from 1.
When you want to resize the window: Drag the red square to zoom in / out.
When you want to cut unnecessary parts: Adjust by dragging the alt key + red square.
This is all about how to display nizima LIVE models on OBS. For other ways to distribute on various video distribution sites or use with conferencing tools, please refer to each service’s website.
Manual uninstallation of OBS plug-ins
If you have uninstalled the OBS plugin but can still select nizima LIVE in OBS, please remove the following
If the installation location of OBS Studio is different, please read C:\Program Files\obs-studio as the installation location.