Doc: add note for training warning
@@ -57,3 +57,46 @@ python tools/preprocess_comp1k_dataset.py data/adobe_composition-1k data/coco da
```
> Currently, only `GCA` supports online composition of training data. But you can modify the data pipeline of other models to perform online composition instead of loading composited images (we called it `merged` in our data pipeline).
+
+### Note
+
+We use the same function to save the generated images as the original script provided by Adobe which will generate png images with incorrect png profile. Thus, it's normal to observe the below warning when training model with single GPU:
+
+```
+libpng warning: iCCP: known incorrect sRGB profile
+libpng warning: iCCP: profile 'ICC Profile': 'GRAY': Gray color space not permitted on RGB PNG
+libpng warning: iCCP: profile 'ICC Profile': 1000000h: invalid rendering intent
+libpng warning: iCCP: profile 'ICC Profile': 0h: PCS illuminant is not D50
+libpng warning: iCCP: profile 'ICC Profile': 'desc': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'wtpt': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'bkpt': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'rXYZ': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'gXYZ': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'bXYZ': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'dmnd': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'dmdd': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'vued': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'view': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'lumi': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'meas': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'tech': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'rTRC': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'gTRC': ICC profile tag start not a multiple of 4
+libpng warning: iCCP: profile 'ICC Profile': 'bTRC': ICC profile tag start not a multiple of 4
+```
+
+Note that we are also putting effort to remove these warnings for better training experience. Thus, any suggestions or contributions are welcomed.
+
+If you find it hard to inspect the training process in CLI, it's recommended to use the `Tensorboard` to keep track on the training process. To do this, you can just simply uncomment the `TensorboardLoggerHook` in model config file.
+
+```python
+log_config = dict(
+ interval=10,
+ hooks=[
+ dict(type='TextLoggerHook', by_epoch=False),
+ dict(type='TensorboardLoggerHook'),
+ # dict(type='PaviLoggerHook', init_kwargs=dict(project='dim'))
+ ])
+```
+
+Optionally, you can also view all the loss log in `work_dir/${EXP_NAME}/${EXP_CREATE_TIME}.log.json`.
