Human Generated Data

Title

Untitled (bar mitzvah)
Date

c. 1950
People

Artist: Samuel Cooper, American active 1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19582

Human Generated Data

Title

Untitled (bar mitzvah)

People

Artist: Samuel Cooper, American active 1950s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 100
Apparel 100
Coat 99.9
Overcoat 99.9
Suit 99.9
Person 99.4
Human 99.4
Person 99.4
Tuxedo 99.2
Person 99.1
Person 98.6
Person 98.4
Person 93.9
Person 92.9
Dress 86.9
Accessories 81.9
Sunglasses 81.9
Accessory 81.9
Fashion 80.8
Robe 80.8
Chair 78.5
Furniture 78.5
Shoe 78.1
Footwear 78.1
Person 77.4
Gown 77
Shirt 76.3
Person 76.2
Wedding 75.6
Bridegroom 75.6
Man 73.8
Helmet 70
Person 68.9
Photography 65.6
Photo 65.6
Face 64.3
Portrait 64.3
Wedding Gown 64
Indoors 60.5
Blazer 59.8
Jacket 59.8
Lab Coat 59
Sailor Suit 58.4
Evening Dress 57.7
Female 57.1
Pillow 55.2
Cushion 55.2
Person 53.6
Person 47.3

Imagga
created on 2022-03-05

brass 50
nurse 43.1
wind instrument 39.2
people 34.6
man 32.4
bugle 31
adult 30.3
male 29.8
musical instrument 27.2
group 25
person 25
businessman 23.8
men 23.2
business 21.8
professional 20.5
cornet 20
happy 18.8
together 18.4
team 17.9
job 16.8
portrait 16.2
worker 16
suit 15.4
standing 14.8
couple 13.9
human 12.7
businesswoman 12.7
medical 12.3
smiling 12.3
clothing 12.2
mature 12.1
teamwork 12
corporate 12
women 11.9
two 11.8
love 11.8
work 11.8
family 11.6
looking 11.2
groom 11
black 10.8
device 10.8
smile 10.7
colleagues 10.7
crowd 10.6
businesspeople 10.4
day 10.2
happiness 10.2
patient 10.2
bride 10
handsome 9.8
40s 9.7
hospital 9.6
uniform 9.5
doctor 9.4
senior 9.4
occupation 9.2
girls 9.1
modern 9.1
silhouette 9.1
old 9.1
medicine 8.8
profession 8.6
20s 8.2
dress 8.1
office 8
laboratory 7.7
attractive 7.7
30s 7.7
health 7.6
casual 7.6
hand 7.6
adults 7.6
wedding 7.4
cheerful 7.3
tourist 7.2
home 7.2
celebration 7.2
romantic 7.1

Google
created on 2022-03-05

Sleeve 87.1
Black-and-white 86.6
Coat 86.4
Gesture 85.3
Style 84
Monochrome 78.7
Monochrome photography 77.8
Font 75.3
Event 73.3
Fashion design 71.7
Art 68.7
Uniform 67.8
Formal wear 66.6
Stock photography 64.8
Happy 63.9
Fun 63.5
Flooring 59.6
Room 59.3
Eyewear 59
Vintage clothing 59

Microsoft
created on 2022-03-05

clothing 93
black and white 92.4
person 92.3
man 89.4
text 84.3
white 62.8
posing 60.1
group 58.4
old 41.1
clothes 20.1

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 82.9%
Calm 88.1%
Happy 9.7%
Surprised 0.5%
Fear 0.4%
Angry 0.4%
Sad 0.3%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 30-40
Gender Male, 58.3%
Calm 67.4%
Happy 27%
Sad 1.6%
Disgusted 1.4%
Confused 0.9%
Surprised 0.8%
Angry 0.6%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Sunglasses 81.9%
Shoe 78.1%
Helmet 70%

Captions

Microsoft

a group of people posing for a photo 91.9%
a group of people posing for the camera 91.8%
a group of people posing for a picture 91.7%

Text analysis

Amazon

28