Human Generated Data

Title

Untitled (outdoor family portrait, seven children cross-legged in front of group)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11254

Human Generated Data

Title

Untitled (outdoor family portrait, seven children cross-legged in front of group)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11254

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 98.4
Person 98.3
Person 98.1
Person 97.9
Person 97.9
Person 97.6
Musician 97.3
Musical Instrument 97.3
Person 97
Person 96.6
Person 96.3
Person 96.1
Person 96.1
Person 95.8
Music Band 95.8
Crowd 95.6
Person 94.6
Person 94.2
Person 93.9
Person 92.8
Person 91.2
Person 91.1
Marching 86.5
Person 85.4
Person 80.6
Person 78.7
People 77.1
Room 74.6
Indoors 74.6
Person 73
Person 65.7

Clarifai
created on 2023-10-27

people 99.9
group 99.5
child 98.4
adult 97.6
many 97.1
woman 96.6
group together 96.1
man 95.6
wear 93.9
wedding 93.7
portrait 93.1
recreation 92.8
son 91.9
art 91.4
boy 90.8
monochrome 90.7
street 88.2
girl 87.5
administration 87
sepia 86.8

Imagga
created on 2022-01-23

wind instrument 42
brass 34.5
musical instrument 34.4
kin 32.2
man 28.9
people 27.3
male 22
silhouette 21.5
person 18.2
men 17.2
group 16.9
cornet 16.3
black 15.1
adult 14.3
women 14.2
sax 14
business 14
couple 13.9
businessman 13.2
walking 12.3
lifestyle 11.5
sport 11.1
sunset 10.8
outdoor 10.7
happy 10.6
outdoors 10.4
friends 10.3
bugle 10.2
accordion 10
human 9.7
portrait 9.7
together 9.6
youth 9.4
friendship 9.3
winter 9.3
harmonica 9.1
sky 8.9
success 8.8
life 8.8
beach 8.4
leisure 8.3
trombone 8.3
park 8.2
active 8.2
device 8.2
dress 8.1
suit 8.1
keyboard instrument 8
job 8
free-reed instrument 7.9
play 7.7
summer 7.7
art 7.7
crowd 7.7
old 7.7
walk 7.6
fun 7.5
action 7.4
protection 7.3
clothing 7.2
team 7.2
holiday 7.2
family 7.1
love 7.1
work 7.1
boy 7.1
happiness 7

Google
created on 2022-01-23

Photograph 94.1
Coat 85.4
Tree 84.7
Suit 77.8
Font 73.5
Blazer 72.2
People in nature 72.1
Event 71.7
Vintage clothing 71.6
Family reunion 71.3
Classic 70.6
Formal wear 70.6
Art 68
Stock photography 63.8
Plant 63
History 62.6
Team 62
Visual arts 53.9
Paper product 52.9
Monochrome 51.7

Microsoft
created on 2022-01-23

posing 99.1
tree 98.8
person 97.5
group 96.2
outdoor 93.3
text 92.5
clothing 90.7
drawing 81.7
old 76.1
cartoon 75.7
man 70.8
people 69.2
sketch 61.3
team 39.2
clothes 15.3
crowd 1.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-48
Gender Female, 79.2%
Calm 50.7%
Happy 44.4%
Sad 1.7%
Surprised 1.1%
Angry 0.8%
Confused 0.6%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 26-36
Gender Female, 99.5%
Happy 71.6%
Calm 17.7%
Surprised 3.7%
Angry 2.1%
Confused 1.9%
Disgusted 1.6%
Fear 0.7%
Sad 0.6%

AWS Rekognition

Age 31-41
Gender Male, 98.3%
Happy 69.4%
Calm 21.9%
Surprised 3.1%
Angry 1.3%
Fear 1.3%
Sad 1.2%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 12-20
Gender Male, 83.7%
Happy 85.2%
Calm 9.3%
Angry 1.4%
Sad 1.3%
Surprised 1.2%
Fear 0.5%
Disgusted 0.5%
Confused 0.5%

AWS Rekognition

Age 35-43
Gender Female, 72.7%
Happy 90.6%
Sad 3.8%
Calm 2.2%
Surprised 0.9%
Angry 0.9%
Disgusted 0.5%
Confused 0.5%
Fear 0.5%

AWS Rekognition

Age 34-42
Gender Female, 97.9%
Happy 92.2%
Disgusted 2.7%
Angry 1.6%
Surprised 0.9%
Confused 0.8%
Calm 0.7%
Fear 0.7%
Sad 0.4%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 99.6%
Angry 0.1%
Confused 0.1%
Sad 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 6-14
Gender Female, 99.7%
Happy 96%
Calm 2.5%
Sad 0.4%
Angry 0.3%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 2-10
Gender Female, 51.3%
Confused 43.6%
Sad 19.9%
Angry 15.8%
Calm 8.6%
Disgusted 5.2%
Happy 3.4%
Surprised 2.1%
Fear 1.4%

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Disgusted 62.6%
Calm 15.4%
Happy 6.4%
Sad 4.3%
Confused 3.4%
Surprised 3.2%
Fear 2.5%
Angry 2.2%

AWS Rekognition

Age 36-44
Gender Male, 100%
Happy 86.3%
Calm 10.6%
Confused 0.9%
Angry 0.7%
Sad 0.5%
Surprised 0.4%
Disgusted 0.4%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 94.9%
Confused 48.2%
Calm 24.9%
Angry 17.3%
Sad 2.4%
Disgusted 2.2%
Fear 2.1%
Surprised 1.5%
Happy 1.4%

AWS Rekognition

Age 27-37
Gender Male, 93.2%
Happy 86%
Calm 7.9%
Angry 1.5%
Confused 1.3%
Disgusted 1%
Surprised 0.8%
Sad 0.7%
Fear 0.6%

AWS Rekognition

Age 28-38
Gender Male, 99.5%
Calm 96.2%
Angry 1.6%
Happy 0.9%
Sad 0.5%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 11-19
Gender Female, 98.8%
Happy 93%
Calm 2%
Sad 1.2%
Disgusted 1%
Surprised 0.8%
Angry 0.8%
Confused 0.6%
Fear 0.6%

AWS Rekognition

Age 23-33
Gender Male, 72.5%
Calm 81%
Happy 6.7%
Confused 3.1%
Sad 3.1%
Angry 2.7%
Surprised 1.6%
Fear 0.9%
Disgusted 0.9%

AWS Rekognition

Age 25-35
Gender Male, 91.2%
Happy 73.6%
Calm 17.5%
Sad 1.7%
Surprised 1.6%
Confused 1.6%
Fear 1.4%
Disgusted 1.3%
Angry 1.2%

AWS Rekognition

Age 54-62
Gender Male, 88.5%
Calm 32.7%
Confused 25.4%
Sad 20.8%
Happy 8.8%
Fear 5.9%
Angry 3.6%
Surprised 1.9%
Disgusted 0.9%

AWS Rekognition

Age 35-43
Gender Female, 99.3%
Angry 51.2%
Happy 29.7%
Disgusted 8.9%
Surprised 3.1%
Calm 2.3%
Confused 2.2%
Sad 1.6%
Fear 1%

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 98.8%
Confused 0.6%
Sad 0.2%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Female, 83.9%
Sad 91.2%
Angry 2.1%
Disgusted 2.1%
Confused 1.9%
Calm 1.5%
Fear 0.5%
Happy 0.4%
Surprised 0.3%

AWS Rekognition

Age 36-44
Gender Female, 99.9%
Happy 50.3%
Calm 41.5%
Sad 2.8%
Confused 2.1%
Surprised 1.1%
Angry 1%
Disgusted 0.6%
Fear 0.5%

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.3%
Person 98.1%
Person 97.9%
Person 97.9%
Person 97.6%
Person 97%
Person 96.6%
Person 96.3%
Person 96.1%
Person 96.1%
Person 95.8%
Person 94.6%
Person 94.2%
Person 93.9%
Person 92.8%
Person 91.2%
Person 91.1%
Person 85.4%
Person 80.6%
Person 78.7%
Person 73%
Person 65.7%