Human Generated Data

Title

Untitled (outdoor family portrait, seven children cross-legged in front of group)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11255

Human Generated Data

Title

Untitled (outdoor family portrait, seven children cross-legged in front of group)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11255

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 98.9
Person 98.9
Person 98.1
Person 97.7
Musician 97.1
Musical Instrument 97.1
Person 97
Person 96.8
Crowd 96.2
Person 95.9
Person 95.8
Person 95.7
Music Band 95.7
Person 95.7
Person 95.5
Person 95.2
Person 93
Person 91.6
Person 91.5
Person 91.1
Room 89.8
Indoors 89.8
Person 89.5
Person 86.6
Person 85.1
Person 81.5
Person 80.6
Marching 80.1
Person 80
People 75.1
Person 68
Theater 63.2
Brass Section 60.3
Person 50.2

Clarifai
created on 2023-10-27

people 99.9
group 99.6
child 98.4
adult 98.1
woman 97.1
portrait 96.8
wear 96.7
art 96.6
many 95.9
sepia 95.6
man 95.5
wedding 93.9
monochrome 93.7
vintage 92.8
son 91.6
girl 90.4
boy 88
administration 87.5
group together 87.5
street 87.2

Imagga
created on 2022-01-23

brass 42.5
wind instrument 37.6
musical instrument 27.8
cornet 24.6
people 23.4
man 21.6
kin 19.5
black 15.1
person 14.8
dress 13.5
portrait 12.9
silhouette 12.4
couple 12.2
adult 11.8
male 11.4
women 11.1
bugle 10.6
grunge 10.2
dark 10
fashion 9.8
old 9.7
business 9.7
group 9.7
men 9.4
winter 9.3
model 9.3
clothing 9.3
elegance 9.2
park 9
human 9
art 9
posing 8.9
detail 8.8
sexy 8.8
businessman 8.8
decoration 8.8
walking 8.5
sport 8.5
tree 8.4
outdoor 8.4
fun 8.2
outdoors 8.2
happy 8.1
snow 8
love 7.9
holiday 7.9
bride 7.7
clothes 7.5
style 7.4
outfit 7.3
dirty 7.2
celebration 7.2
hair 7.1
family 7.1

Google
created on 2022-01-23

Tree 88.7
Coat 87.2
People in nature 80.7
Adaptation 79.2
Suit 77
Classic 75.1
Vintage clothing 73.9
Plant 73.3
Event 72.6
Family reunion 72
Art 71.4
Font 71.2
Team 69.5
Blazer 69.4
Formal wear 65.2
History 63.1
Stock photography 62.9
Monochrome 62.6
Visual arts 56.8
Rectangle 56.5

Microsoft
created on 2022-01-23

tree 99.1
posing 96.3
group 95.4
clothing 94.5
person 93.7
outdoor 92.2
drawing 90.2
text 88.8
cartoon 82.2
sketch 75
old 74.8
man 73.5
woman 65.9
people 64.1
clothes 23.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 95.3%
Happy 83.9%
Calm 10%
Surprised 2.5%
Sad 1.3%
Angry 1%
Confused 0.6%
Fear 0.5%
Disgusted 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Calm 99.5%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Surprised 0.1%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Happy 63.3%
Calm 34.9%
Sad 0.6%
Surprised 0.4%
Angry 0.3%
Confused 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Calm 70.4%
Happy 17.1%
Sad 5.6%
Surprised 2.3%
Confused 1.6%
Angry 1.4%
Fear 1.2%
Disgusted 0.4%

AWS Rekognition

Age 6-16
Gender Male, 50.5%
Happy 98.7%
Calm 0.6%
Surprised 0.2%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 94.5%
Sad 1.8%
Happy 1.1%
Angry 1.1%
Fear 0.4%
Confused 0.4%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 31-41
Gender Female, 99.8%
Calm 77.9%
Happy 14.9%
Surprised 2.8%
Angry 1.6%
Confused 1.3%
Disgusted 0.7%
Sad 0.5%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Female, 51.9%
Calm 86.4%
Happy 7.7%
Angry 1.6%
Sad 1.4%
Surprised 1.2%
Disgusted 0.6%
Fear 0.6%
Confused 0.6%

AWS Rekognition

Age 34-42
Gender Female, 94.9%
Calm 92.7%
Happy 2.4%
Sad 1.7%
Angry 1.1%
Surprised 0.8%
Disgusted 0.6%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Female, 83.3%
Happy 93.2%
Calm 4%
Surprised 0.7%
Sad 0.6%
Angry 0.5%
Confused 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 47-53
Gender Male, 94.8%
Confused 40.3%
Calm 16.3%
Happy 14.7%
Angry 10%
Sad 7%
Disgusted 4.7%
Surprised 4.1%
Fear 2.9%

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Happy 60.8%
Angry 13.8%
Calm 9.7%
Disgusted 5.1%
Confused 4.1%
Surprised 2.8%
Fear 2.1%
Sad 1.6%

AWS Rekognition

Age 35-43
Gender Male, 100%
Happy 98.1%
Calm 0.6%
Confused 0.4%
Angry 0.4%
Surprised 0.2%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 66.7%
Happy 63.2%
Disgusted 8%
Calm 6.8%
Angry 5.5%
Confused 5.4%
Surprised 5.4%
Sad 3.5%
Fear 2.1%

AWS Rekognition

Age 22-30
Gender Female, 97.3%
Disgusted 69.2%
Angry 18.2%
Calm 3.1%
Confused 2.7%
Fear 1.9%
Sad 1.8%
Happy 1.7%
Surprised 1.4%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Disgusted 92.9%
Happy 2.2%
Calm 2%
Sad 1%
Confused 0.9%
Angry 0.5%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 16-22
Gender Male, 73.2%
Calm 48.4%
Happy 37%
Sad 5.5%
Surprised 4.1%
Angry 2.1%
Fear 1%
Disgusted 0.9%
Confused 0.9%

AWS Rekognition

Age 35-43
Gender Female, 99.9%
Happy 54.9%
Calm 36.8%
Confused 2%
Sad 2%
Surprised 1.4%
Disgusted 1.3%
Angry 0.9%
Fear 0.6%

AWS Rekognition

Age 52-60
Gender Female, 99.9%
Calm 90%
Confused 3.6%
Sad 2.8%
Angry 1.4%
Happy 0.8%
Surprised 0.7%
Fear 0.4%
Disgusted 0.4%

AWS Rekognition

Age 14-22
Gender Female, 52.9%
Angry 89.6%
Confused 6.2%
Disgusted 1.4%
Calm 0.8%
Sad 0.7%
Happy 0.6%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 6-14
Gender Female, 96.5%
Happy 80.4%
Disgusted 6.3%
Confused 3.7%
Calm 3.6%
Sad 2%
Angry 1.9%
Fear 1.2%
Surprised 1%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 82.5%
Sad 7.1%
Surprised 3.8%
Confused 2.6%
Angry 1.7%
Disgusted 1.2%
Happy 0.7%
Fear 0.4%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.9%
Person 98.1%
Person 97.7%
Person 97%
Person 96.8%
Person 95.9%
Person 95.8%
Person 95.7%
Person 95.7%
Person 95.5%
Person 95.2%
Person 93%
Person 91.6%
Person 91.5%
Person 91.1%
Person 89.5%
Person 86.6%
Person 85.1%
Person 81.5%
Person 80.6%
Person 80%
Person 68%
Person 50.2%