Human Generated Data

Title

Untitled (crowd of people in ballroom)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16707

Human Generated Data

Title

Untitled (crowd of people in ballroom)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.4
Apparel 99.4
Human 99.2
Person 99.2
Person 98.4
Person 97.8
Person 97.7
Person 97
Person 96.4
Person 95.9
Dress 95.3
Person 91.6
Suit 91.3
Overcoat 91.3
Coat 91.3
Person 90.8
Female 90.5
Person 88.7
Person 88.6
Furniture 86.6
Person 86.4
Person 82.4
People 81.2
Footwear 80
Shoe 80
Shoe 79.4
Person 77.9
Woman 77
Floor 71.6
Indoors 70.2
Chair 67.8
Girl 66.6
Room 63.4
Face 63
Table 61.9
Gown 61.4
Fashion 61.4
Flooring 61.2
Shorts 59.4
Robe 59.3
Evening Dress 59.3
Tuxedo 58.4
Living Room 57.8
Accessories 57.3
Tie 57.3
Accessory 57.3
Child 56.9
Kid 56.9

Imagga
created on 2022-02-26

people 40.1
person 36.5
group 34.6
men 29.2
man 28.2
dancer 27.8
adult 27
male 26.2
professional 24.7
performer 24
teacher 23.2
women 22.9
business 21.8
team 20.6
brass 19.6
businessman 19.4
happy 18.8
kin 17.7
educator 17.5
silhouette 17.4
wind instrument 16.7
entertainer 16.5
couple 16.5
crowd 16.3
work 15.7
portrait 15.5
dress 14.4
human 14.2
nurse 13.6
art 12.9
musical instrument 12.3
standing 12.2
casual 11.9
family 11.5
fashion 11.3
girls 10.9
worker 10.9
silhouettes 10.7
together 10.5
party 10.3
corporate 10.3
teamwork 10.2
happiness 10.2
two 10.2
life 10
black 9.6
celebration 9.6
boy 9.6
active 9.5
lifestyle 9.4
occupation 9.2
design 9
suit 9
fun 9
activity 8.9
style 8.9
success 8.8
hands 8.7
smiling 8.7
love 8.7
motion 8.6
smile 8.5
walking 8.5
sport 8.5
modern 8.4
dance 8.4
uniform 8.3
businesswoman 8.2
exercise 8.2
groom 8.1
lady 8.1
outfit 8
job 8
indoors 7.9
urban 7.9
color 7.8
sitting 7.7
attractive 7.7
pretty 7.7
diversity 7.7
bride 7.7
friendship 7.5
company 7.4
wedding 7.3
indoor 7.3
children 7.3
interior 7.1
day 7.1
world 7.1

Google
created on 2022-02-26

Dress 84.4
Style 83.8
Painting 82.1
Art 81.1
Picture frame 73.5
Event 72.8
Classic 72.1
Vintage clothing 71.9
Monochrome 71.9
Drawing 71.2
Illustration 70.8
Room 69.4
Visual arts 68.5
Monochrome photography 67.9
Fashion design 64.3
History 64
Suit 63.3
Font 62.6
Child 62.4
Collection 58.3

Microsoft
created on 2022-02-26

person 96.5
dress 89.6
clothing 88.6
wedding dress 87.8
woman 86.6
standing 85.7
text 77.8
bride 64.2
group 58.2
posing 55.5
room 54.2
clothes 15.9

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 95.3%
Sad 34.8%
Confused 16.2%
Disgusted 14.4%
Calm 9.4%
Surprised 8%
Angry 7.9%
Fear 7.4%
Happy 1.8%

AWS Rekognition

Age 40-48
Gender Male, 95.6%
Calm 68.8%
Sad 23.7%
Happy 2.5%
Confused 2.4%
Disgusted 1%
Surprised 0.7%
Angry 0.7%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Sad 96.1%
Fear 1.4%
Disgusted 0.6%
Angry 0.5%
Confused 0.5%
Happy 0.4%
Calm 0.3%
Surprised 0.2%

AWS Rekognition

Age 25-35
Gender Female, 88.3%
Calm 64.2%
Sad 14.7%
Fear 8.5%
Confused 6.1%
Happy 3.4%
Disgusted 1.5%
Angry 0.8%
Surprised 0.8%

AWS Rekognition

Age 50-58
Gender Male, 98.5%
Sad 67%
Happy 29.8%
Fear 1.2%
Angry 0.8%
Surprised 0.4%
Confused 0.3%
Calm 0.3%
Disgusted 0.2%

AWS Rekognition

Age 40-48
Gender Male, 90.4%
Sad 50.1%
Confused 25.2%
Calm 21.6%
Angry 1%
Disgusted 0.8%
Happy 0.6%
Surprised 0.5%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Female, 88.6%
Calm 67.2%
Happy 15.9%
Sad 7.7%
Confused 3.2%
Angry 3.1%
Surprised 1.2%
Disgusted 0.9%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Shoe 80%
Tie 57.3%

Captions

Microsoft

a group of people standing in a room 97.1%
a group of people posing for a photo 91.3%
a group of people standing in front of a window 88.4%

Text analysis

Amazon

US

Google

YT37A°2
MJI7-- YT37A°2 --XAGON
MJI7--
--XAGON