Human Generated Data

Title

Untitled (a Nawab?)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.80

Human Generated Data

Title

Untitled (a Nawab?)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.80

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 99.8
Human 99.8
Person 99.6
Person 99.4
Person 99.1
Person 98.7
Person 96.6
People 93.4
Person 93.1
Person 92.9
Person 88.9
Person 82.5
Person 80.6
Person 76.3
Person 74.2
Crowd 74
Person 73.1
Person 71.2
Painting 69.9
Art 69.9
Family 59.9
Military 57.7
Military Uniform 57.7
Clothing 56
Apparel 56
Person 49

Clarifai
created on 2018-10-19

people 100
group 99.5
many 99.3
adult 99.1
group together 97.9
man 95.1
war 94.9
woman 94.7
military 94.5
wear 94.3
child 92.6
administration 91.7
outfit 88.9
boy 86.5
soldier 86
spectator 83.5
several 82.7
music 82.3
skirmish 81.2
gun 80.7

Imagga
created on 2018-10-19

brass 39
wind instrument 33.3
musical instrument 31.1
trombone 28.3
uniform 24.1
people 22.9
man 21.5
weapon 18.8
military uniform 17.8
clothing 17.1
male 16.3
person 13.9
outdoor 13.8
sport 13.5
military 13.5
two 12.7
war 12.5
adult 12.4
silhouette 12.4
walking 12.3
men 12
outdoors 11.9
summer 10.3
women 10.3
active 10.2
leisure 10
vacation 9.8
old 9.7
black 9.6
couple 9.6
holiday 9.3
field 9.2
travel 9.1
family 8.9
group 8.9
soldier 8.8
together 8.8
play 8.6
outside 8.6
child 8.5
stringed instrument 8.5
protection 8.2
danger 8.2
life 8.2
banjo 8.2
private 8.1
history 8
lifestyle 7.9
day 7.8
happiness 7.8
boy 7.8
warrior 7.8
sky 7.6
walk 7.6
statue 7.6
horse 7.6
covering 7.6
bugle 7.5
fun 7.5
mother 7.4
holding 7.4
park 7.4
tradition 7.4
world 7.3
consumer goods 7.3
girls 7.3
tourist 7.2
recreation 7.2
activity 7.2
grass 7.1
love 7.1

Google
created on 2018-10-19

Microsoft
created on 2018-10-19

person 99.9
outdoor 99.5
group 97.7
posing 97.4
standing 95.6
old 93.6
people 93.1
sport 73.3
white 62.5
vintage 36.8
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 56.4%
Confused 2.3%
Happy 1%
Calm 25.9%
Disgusted 8%
Angry 4.9%
Sad 56.1%
Surprised 1.8%

AWS Rekognition

Age 26-43
Gender Male, 94.1%
Angry 2.4%
Disgusted 2.3%
Sad 9.9%
Happy 5.3%
Confused 1.8%
Calm 74.3%
Surprised 3.9%

AWS Rekognition

Age 26-44
Gender Male, 78.7%
Disgusted 6.3%
Sad 12.7%
Confused 5%
Angry 7%
Happy 4.4%
Calm 58.9%
Surprised 5.8%

AWS Rekognition

Age 26-44
Gender Male, 96.5%
Calm 79.9%
Disgusted 1.4%
Confused 2.3%
Sad 3.4%
Angry 10.2%
Happy 1.2%
Surprised 1.8%

AWS Rekognition

Age 26-43
Gender Male, 95.7%
Sad 33.6%
Confused 5.9%
Angry 5.1%
Disgusted 1.4%
Happy 0.8%
Surprised 1.5%
Calm 51.7%

AWS Rekognition

Age 20-38
Gender Female, 89.2%
Confused 0.5%
Angry 2.3%
Surprised 0.5%
Calm 0.8%
Disgusted 0.8%
Happy 0.5%
Sad 94.6%

AWS Rekognition

Age 35-53
Gender Female, 66.7%
Sad 85.3%
Confused 1.7%
Disgusted 5.4%
Happy 1.6%
Angry 1.6%
Calm 3.3%
Surprised 1.1%

AWS Rekognition

Age 35-52
Gender Male, 75.7%
Confused 4.6%
Disgusted 1.9%
Sad 41.4%
Angry 10%
Calm 36.1%
Happy 3.2%
Surprised 2.9%

AWS Rekognition

Age 26-44
Gender Male, 92.7%
Disgusted 4.6%
Happy 6.7%
Surprised 5.4%
Sad 30.4%
Calm 25.2%
Angry 13.1%
Confused 14.5%

AWS Rekognition

Age 26-43
Gender Male, 99.1%
Angry 5.5%
Surprised 4.2%
Calm 41.8%
Sad 35.7%
Disgusted 2.1%
Confused 8.3%
Happy 2.4%

AWS Rekognition

Age 26-43
Gender Female, 68.2%
Confused 1.2%
Disgusted 4.5%
Calm 63%
Sad 16.6%
Surprised 2.7%
Happy 5.1%
Angry 6.8%

AWS Rekognition

Age 26-43
Gender Female, 72.3%
Sad 67.8%
Angry 8%
Disgusted 4.5%
Calm 6.6%
Surprised 3.7%
Happy 6.1%
Confused 3.3%

AWS Rekognition

Age 26-43
Gender Female, 70.4%
Sad 51.3%
Disgusted 4.2%
Angry 4.3%
Happy 16.1%
Confused 3.9%
Surprised 2.8%
Calm 17.4%

AWS Rekognition

Age 57-77
Gender Female, 69.9%
Surprised 3.2%
Calm 25.9%
Angry 13.4%
Sad 15%
Happy 21.4%
Confused 2.8%
Disgusted 18.3%

AWS Rekognition

Age 48-68
Gender Male, 77.2%
Angry 9%
Disgusted 2.6%
Happy 14.7%
Calm 29.7%
Sad 35.4%
Confused 4.6%
Surprised 4.1%

AWS Rekognition

Age 30-47
Gender Male, 53.1%
Disgusted 45.4%
Happy 45.2%
Surprised 45.5%
Sad 51.6%
Calm 46.4%
Angry 45.7%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 87.7%
Sad 5%
Confused 0.7%
Angry 1.1%
Disgusted 0.5%
Happy 0.5%
Surprised 0.7%
Calm 91.5%

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 69.9%