Human Generated Data

Title

Untitled (couple dancing)

Date

1964

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19210

Human Generated Data

Title

Untitled (couple dancing)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Clothing 99.8
Apparel 99.8
Person 97.4
Human 97.4
Person 97
Overcoat 92.5
Suit 92.5
Coat 92.5
Accessories 88.6
Accessory 88.6
Tie 88.6
Robe 87.9
Fashion 87.9
Gown 86
Person 82
Tuxedo 80
Wedding 76.8
Wedding Gown 69.6
Female 68.7
Evening Dress 65.7
Advertisement 65.4
Poster 61.4
Woman 56.9
Brochure 56.2
Paper 56.2
Flyer 56.2
Bride 55.8
Bridegroom 55.4

Imagga
created on 2022-02-25

locker 35.5
fastener 28.4
book jacket 23.8
jacket 21.9
man 21.5
restraint 21.4
people 20.6
business 18.8
person 18.7
black 18.6
device 16.5
male 16.3
office 16.2
adult 15.9
wrapping 15
portrait 14.2
businessman 14.1
covering 14
attractive 14
face 13.5
old 13.2
silhouette 12.4
corporate 12
happy 11.9
women 11.9
work 11.8
dress 11.7
sexy 11.2
manager 11.2
smile 10.7
job 10.6
couple 10.5
one 10.4
standing 10.4
looking 10.4
fashion 9.8
lady 9.7
boy 9.7
brunette 9.6
executive 9.5
professional 9.3
model 9.3
communication 9.2
vintage 9.1
pretty 9.1
worker 9.1
clothing 9
human 9
call 8.8
lifestyle 8.7
holding 8.3
businesswoman 8.2
cheerful 8.1
financial 8
sad 7.7
casual 7.6
two 7.6
studio 7.6
head 7.6
group 7.3
pose 7.2
body 7.2
art 7.2
posing 7.1
working 7.1

Google
created on 2022-02-25

Smile 94.6
Coat 93.6
Bride 90.5
Wedding dress 85.7
Gesture 85.3
Suit 85
Flash photography 83.5
Blazer 77
Formal wear 76.7
Picture frame 75.1
Happy 72.1
Event 71.3
Vintage clothing 69.8
Classic 69.4
Room 67.7
Gown 67.4
Rectangle 66.4
Art 65.7
Stock photography 63.1
Photographic paper 60.4

Microsoft
created on 2022-02-25

text 99.7
person 94.6
clothing 90.2
suit 85.4
wedding dress 82.9
man 78.2
dress 77.5
posing 75
human face 74.7
smile 74.4
bride 73
poster 57.2
picture frame 52.2
woman 51.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 97.3%
Happy 96.9%
Surprised 1.8%
Fear 0.5%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%
Sad 0.1%
Calm 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Happy 99.1%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Calm 0.1%
Sad 0%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Tie 88.6%

Captions

Microsoft

a group of people posing for a photo 82.3%
a group of people posing for the camera 82.2%
a person standing in front of a group of people posing for a photo 67.7%

Text analysis

Amazon

DEC
64
358
131

Google

358
358 131 DEC 64
DEC
64
131