Objective: In this paper, we propose to evaluate the use of a pre-trained convolutional neural networks (CNNs) as a features extractor followed by the Principal Component Analysis (PCA) to find the best discriminant features to perform classification using support vector machine (SVM) algorithm for neonatal sleep and wake states using Fluke® facial video frames. Using pre-trained CNNs as feature extractor would hugely reduce the effort of collecting new neonatal data for training a neural network which could be computationally very expensive. The features are extracted after fully connected layers (FCL’s), where we compare several pre-trained CNNs, e.g., VGG16, VGG19, InceptionV3, GoogLeNet, ResNet, and AlexNet.
Results: From around 2-h Fluke® video recording of seven neonate, we achieved a modest classification performance with an accuracy, sensitivity, and specificity of 65.3%, 69.8%, 61.0%, respectively with AlexNet using Fluke® (RGB) video frames. This indicates that using a pre-trained model as a feature extractor could not fully suffice for highly reliable sleep and wake classification in neonates. Therefore, in future a dedicated neural network trained on neonatal data or a transfer learning approach is required.

Figure 1

Figure 2
This is a list of supplementary files associated with this preprint. Click to download.
Additional file 1 Table S1. Neonatal body condition before the collection of video and VEEG data, The detailed descriptions of the demographics and physical conditions of neonates.
Additional file 1: Table S2. Overall ConvNet’s architecture, The details descriptions of all the pre-trained model has been mentioned.
Additional file 1: Table S3. Neonatal sleep and wake states classification results using Fluke® multiple colors palattes, statistical results achieved using multiple color palettes such as amber, high contrast, red-blue, hot metal, and grayscale.
Additional file 1: Figure S1. Fluke® color palettes range.
Loading...
On 18 Oct, 2020
On 13 Oct, 2020
Posted 22 Sep, 2020
Received 02 Oct, 2020
On 22 Sep, 2020
On 18 Sep, 2020
Invitations sent on 18 Sep, 2020
On 17 Sep, 2020
On 17 Sep, 2020
On 11 Sep, 2020
Received 08 Sep, 2020
On 29 Aug, 2020
Invitations sent on 26 Aug, 2020
On 22 Aug, 2020
On 20 Aug, 2020
On 20 Aug, 2020
On 18 Oct, 2020
On 13 Oct, 2020
Posted 22 Sep, 2020
Received 02 Oct, 2020
On 22 Sep, 2020
On 18 Sep, 2020
Invitations sent on 18 Sep, 2020
On 17 Sep, 2020
On 17 Sep, 2020
On 11 Sep, 2020
Received 08 Sep, 2020
On 29 Aug, 2020
Invitations sent on 26 Aug, 2020
On 22 Aug, 2020
On 20 Aug, 2020
On 20 Aug, 2020
Objective: In this paper, we propose to evaluate the use of a pre-trained convolutional neural networks (CNNs) as a features extractor followed by the Principal Component Analysis (PCA) to find the best discriminant features to perform classification using support vector machine (SVM) algorithm for neonatal sleep and wake states using Fluke® facial video frames. Using pre-trained CNNs as feature extractor would hugely reduce the effort of collecting new neonatal data for training a neural network which could be computationally very expensive. The features are extracted after fully connected layers (FCL’s), where we compare several pre-trained CNNs, e.g., VGG16, VGG19, InceptionV3, GoogLeNet, ResNet, and AlexNet.
Results: From around 2-h Fluke® video recording of seven neonate, we achieved a modest classification performance with an accuracy, sensitivity, and specificity of 65.3%, 69.8%, 61.0%, respectively with AlexNet using Fluke® (RGB) video frames. This indicates that using a pre-trained model as a feature extractor could not fully suffice for highly reliable sleep and wake classification in neonates. Therefore, in future a dedicated neural network trained on neonatal data or a transfer learning approach is required.

Figure 1

Figure 2
This is a list of supplementary files associated with this preprint. Click to download.
Additional file 1 Table S1. Neonatal body condition before the collection of video and VEEG data, The detailed descriptions of the demographics and physical conditions of neonates.
Additional file 1: Table S2. Overall ConvNet’s architecture, The details descriptions of all the pre-trained model has been mentioned.
Additional file 1: Table S3. Neonatal sleep and wake states classification results using Fluke® multiple colors palattes, statistical results achieved using multiple color palettes such as amber, high contrast, red-blue, hot metal, and grayscale.
Additional file 1: Figure S1. Fluke® color palettes range.
Loading...