Human Generated Data

Title

Untitled (people dancing at ball)

Date

c. 1966

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19234

Human Generated Data

Title

Untitled (people dancing at ball)

People

Artist: Robert Burian, American active 1940s-1950s

Date

c. 1966

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Apparel 99.9
Clothing 99.9
Person 98.7
Human 98.7
Person 98.6
Person 98.1
Fashion 97.3
Gown 97.3
Evening Dress 97.3
Robe 97.3
Person 97.2
Person 96.9
Female 81.7
Sleeve 77.3
People 72
Advertisement 70.4
Poster 70.4
Long Sleeve 68.4
Woman 65.6
Dress 59.1
Leisure Activities 57.7
Overcoat 56.4
Coat 56.4
Person 48.2

Imagga
created on 2022-02-25

groom 78.7
bride 47.5
dress 37
people 31.2
person 29.7
wedding 28.5
man 26.2
male 24.8
love 24.5
couple 24.4
marriage 22.8
adult 22.7
clothing 18.4
fashion 18.1
happy 17.5
silhouette 17.4
bouquet 17.2
sexy 16.9
dinner dress 16.2
happiness 15.7
married 14.4
newlywed 14.2
flowers 13.9
black 13.6
job 13.3
model 13.2
gown 13
outfit 12.8
businessman 12.4
pretty 11.9
attractive 11.9
women 11.9
design 11.8
bridal 11.7
romance 11.6
posing 11.5
boss 11.5
bright 11.4
face 11.4
robe 11.2
party 11.2
teamwork 11.1
president 10.8
nighttime 10.8
flower 10.8
team 10.7
leader 10.6
crowd 10.6
looking 10.4
celebration 10.4
portrait 10.3
business 10.3
youth 10.2
work 10.2
spouse 10.2
church 10.2
two 10.2
suit 10
businesswoman 10
smile 10
supporters 9.9
matrimony 9.8
commitment 9.8
veil 9.8
cheering 9.8
speech 9.8
audience 9.7
stadium 9.7
ceremony 9.7
style 9.6
together 9.6
vibrant 9.6
patriotic 9.6
hair 9.5
nation 9.5
symbol 9.4
smiling 9.4
presentation 9.3
vivid 9.3
lights 9.3
joy 9.2
flag 9.2
occupation 9.2
pose 9.1
lady 8.9
garment 8.8
men 8.6
wife 8.5
boutique 8.4
holding 8.3
human 8.2
dance 8.2
romantic 8
icon 7.9
dancing 7.7
formal 7.6
hand 7.6
females 7.6
elegance 7.6
dark 7.5
fun 7.5
husband 7.4
new 7.3
holiday 7.2
day 7.1
teacher 7.1

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 99.6
wedding dress 98.2
dress 97.4
bride 97.2
clothing 83.6
wedding 83.3
woman 78.3
person 69.1
gallery 66
posing 58.3
picture frame 54.3
room 46.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Happy 99.6%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0%
Confused 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Happy 99.9%
Surprised 0%
Fear 0%
Angry 0%
Sad 0%
Disgusted 0%
Calm 0%
Confused 0%

AWS Rekognition

Age 57-65
Gender Female, 100%
Calm 38.8%
Happy 27.1%
Surprised 14%
Fear 9.7%
Disgusted 3.5%
Sad 2.9%
Angry 2.1%
Confused 1.8%

AWS Rekognition

Age 24-34
Gender Female, 99.5%
Calm 99.9%
Sad 0%
Disgusted 0%
Angry 0%
Fear 0%
Surprised 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 52.7%
Angry 12%
Confused 9.7%
Sad 7.1%
Surprised 6.7%
Disgusted 4.6%
Fear 3.6%
Happy 3.6%

AWS Rekognition

Age 23-33
Gender Female, 95.4%
Disgusted 35.9%
Fear 34.7%
Calm 17.1%
Sad 7.9%
Surprised 1.7%
Confused 1.4%
Angry 0.7%
Happy 0.5%

AWS Rekognition

Age 22-30
Gender Male, 95.7%
Fear 92.7%
Surprised 2.8%
Disgusted 1.4%
Angry 0.8%
Confused 0.8%
Sad 0.7%
Calm 0.5%
Happy 0.3%

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Fear 41.4%
Calm 25.6%
Sad 13.6%
Confused 7.3%
Angry 4.6%
Disgusted 3.8%
Surprised 2.5%
Happy 1.2%

AWS Rekognition

Age 38-46
Gender Male, 94.4%
Sad 84.1%
Disgusted 5.7%
Angry 4%
Calm 3.4%
Confused 1.2%
Happy 1%
Surprised 0.4%
Fear 0.2%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 62
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Poster 70.4%

Captions

Microsoft

a group of people posing for a photo 60.9%
a group of people posing for a picture 60.8%
a group of people posing for the camera 60.7%

Text analysis

Amazon

369
133

Google

369 133
133
369