Human Generated Data

Title

Untitled (group portrait of boy basketball players standing with females cheerleaders crouching on ground)

Date

1952-1953

People

Artist: Orrion Barger, American active 1913 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6696

Human Generated Data

Title

Untitled (group portrait of boy basketball players standing with females cheerleaders crouching on ground)

People

Artist: Orrion Barger, American active 1913 - 1984

Date

1952-1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Person 99.3
Person 99.3
Person 99.2
Person 99.2
Person 99.1
Person 99
Person 98.9
Person 98.7
Person 98.3
Person 97.9
Clothing 96.3
Apparel 96.3
Person 93.8
Female 92.3
Person 91.6
Person 87.9
People 82
Sports 79.4
Sport 79.4
Crowd 78.1
Girl 74.9
Advertisement 65
Poster 65
Costume 63.3
Boy 62.8
Person 61.3
Woman 60.3
Shorts 58.9
Martial Arts 56.5
Child 55.6
Kid 55.6

Imagga
created on 2022-01-22

person 40.9
adult 33.7
people 32.3
professional 27.5
performer 27.5
dancer 27.2
teacher 25.8
man 24.8
male 22
fashion 21.8
attractive 21.7
nurse 21.5
happy 20.7
couple 20
dress 19.9
women 19
sexy 18.5
entertainer 18.2
educator 18
group 17.7
portrait 16.8
love 16.6
happiness 16.4
men 16.3
businessman 15.9
smiling 15.2
model 14.8
black 14.6
smile 14.2
family 14.2
style 14.1
room 14
together 14
pretty 14
business 14
fun 13.5
elegance 13.4
holding 13.2
brunette 12.2
student 11.9
clothing 11.6
sitting 11.2
singer 11
lifestyle 10.8
home 10.4
pose 10
human 9.7
bride 9.7
body 9.6
boy 9.6
groom 9.5
passion 9.4
casual 9.3
two 9.3
girls 9.1
musician 9.1
suit 9
team 8.9
handsome 8.9
posing 8.9
interior 8.8
office 8.8
indoors 8.8
celebration 8.8
standing 8.7
desire 8.6
work 8.6
formal 8.6
party 8.6
corporate 8.6
businesspeople 8.5
fashionable 8.5
face 8.5
youth 8.5
bouquet 8.5
child 8.4
hand 8.3
wedding 8.3
20s 8.2
one 8.2
businesswoman 8.2
worker 8.1
cheerful 8.1
lady 8.1
success 8
hair 7.9
cute 7.9
husband 7.8
modern 7.7
elegant 7.7
studio 7.6
wife 7.6
vintage 7.4
retro 7.4
executive 7.4
teen 7.3
indoor 7.3
sensuality 7.3
enrollee 7.2
stylish 7.2
job 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

posing 99.9
person 99.7
wall 99.2
clothing 95.5
group 94.2
text 90.3
standing 86.7
smile 84.8
man 72
team 63.2
old 56.1
clothes 54.5
female 31.3
dressed 25.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-19
Gender Female, 100%
Happy 99%
Surprised 0.4%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Calm 0.1%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.6%
Calm 98.1%
Surprised 0.6%
Confused 0.4%
Fear 0.3%
Angry 0.2%
Sad 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 11-19
Gender Male, 99.9%
Happy 99.2%
Surprised 0.2%
Calm 0.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 7-17
Gender Female, 100%
Happy 99.1%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%
Calm 0.1%
Sad 0%

AWS Rekognition

Age 21-29
Gender Female, 63.5%
Happy 93.5%
Surprised 3.3%
Calm 1.2%
Fear 0.5%
Disgusted 0.5%
Confused 0.4%
Sad 0.4%
Angry 0.3%

AWS Rekognition

Age 19-27
Gender Male, 99.1%
Calm 99.7%
Confused 0.1%
Happy 0.1%
Angry 0%
Sad 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 13-21
Gender Female, 97.1%
Calm 78.7%
Angry 5.8%
Disgusted 4.8%
Confused 3.1%
Sad 2.3%
Surprised 2.1%
Happy 2%
Fear 1.1%

AWS Rekognition

Age 13-21
Gender Female, 99.9%
Calm 94.1%
Happy 1.7%
Confused 1.7%
Sad 0.8%
Angry 0.6%
Disgusted 0.5%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Happy 92.8%
Calm 1.9%
Angry 1.7%
Surprised 1.5%
Disgusted 0.6%
Sad 0.5%
Confused 0.5%
Fear 0.5%

AWS Rekognition

Age 14-22
Gender Male, 99.9%
Happy 96.1%
Calm 2.2%
Surprised 0.5%
Confused 0.4%
Angry 0.3%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Female, 100%
Happy 82.2%
Sad 3.9%
Confused 3.6%
Calm 2.8%
Disgusted 2.7%
Fear 1.7%
Surprised 1.7%
Angry 1.4%

AWS Rekognition

Age 7-17
Gender Male, 99.5%
Surprised 39.5%
Happy 34.2%
Calm 16.3%
Disgusted 2.7%
Confused 2.6%
Angry 1.8%
Fear 1.7%
Sad 1.2%

AWS Rekognition

Age 18-24
Gender Male, 98.8%
Calm 99%
Happy 0.4%
Angry 0.1%
Sad 0.1%
Fear 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 99.2%
Calm 71%
Happy 24.6%
Confused 1.9%
Angry 0.7%
Sad 0.7%
Surprised 0.5%
Fear 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Poster 65%

Captions

Microsoft

a group of people posing for a photo 98.9%
a group of people posing for the camera 98.8%
a group of people posing for a picture 98.7%

Text analysis

Amazon

15
6
5
9
4
13
3
7

Google

6
4
15
9
15 15 3 13 9 6 4 6
13
3