Human Generated Data

Title

Untitled (bar mitzvah party with cake)

Date

1966

People

Artist: Samuel Cooper, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19625

Human Generated Data

Title

Untitled (bar mitzvah party with cake)

People

Artist: Samuel Cooper, American active 1950s

Date

1966

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99
Person 99
Person 98.5
Person 98.5
Person 98
Person 98
Person 97
Clothing 96.1
Apparel 96.1
Person 93.7
Crowd 88.9
Person 85.7
Person 85
People 83.8
Suit 83.4
Overcoat 83.4
Coat 83.4
Face 79.3
Tablecloth 76.8
Person 69.9
Photo 67.8
Photography 67.8
Portrait 65.9
Female 58.9
Shorts 58.9
Tuxedo 57.7
Gown 57.7
Fashion 57.7
Shirt 57.3
Helmet 56.5
Food 55.7
Dessert 55.7

Imagga
created on 2022-03-05

brass 55.5
wind instrument 43.9
people 36.8
man 31.6
musical instrument 30.3
businessman 30
men 29.2
person 28.8
business 27.3
male 26.9
group 26.6
crowd 24
team 23.3
silhouette 20.7
teamwork 19.4
cornet 19.2
work 18.8
adult 18.3
women 17.4
job 15
businesswoman 14.5
stage 13.9
boss 13.4
trombone 13.3
couple 13.1
presentation 13
executive 12.9
audience 12.7
professional 12.6
meeting 12.2
corporate 12
happy 11.3
black 10.9
symbol 10.8
leader 10.6
success 10.4
sexy 10.4
party 10.3
manager 10.2
occupation 10.1
suit 10
fashion 9.8
nighttime 9.8
bugle 9.7
office 9.6
performance 9.6
clothing 9.4
lights 9.3
girls 9.1
design 9
fun 9
cheering 8.8
speech 8.8
stadium 8.7
vibrant 8.7
standing 8.7
patriotic 8.6
play 8.6
active 8.6
nation 8.5
friendship 8.4
communication 8.4
music 8.3
flag 8.2
worker 8
together 7.9
bright 7.9
president 7.8
concert 7.8
sport 7.7
employee 7.7
youth 7.7
casual 7.6
human 7.5
vivid 7.4
life 7.3
musician 7.1
handsome 7.1
icon 7.1
portrait 7.1
happiness 7
player 7
supporter 7

Google
created on 2022-03-05

Coat 87
Black-and-white 86.1
Gesture 85.3
Style 84
Font 81.4
Adaptation 79.2
Art 77.8
Monochrome photography 74.4
Monochrome 74.2
Event 73.3
Suit 69.5
Vintage clothing 66.1
Crowd 65.6
Uniform 63.8
Crew 63.2
Stock photography 62.5
Team 61.5
Eyewear 60.3
Room 59.4
Photographic paper 59.2

Microsoft
created on 2022-03-05

clothing 97.1
person 95.7
black and white 92.4
man 87.2
woman 80
text 76.9
people 72.3
wedding dress 69.3
dress 52.2
wedding 51.2

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 94.3%
Calm 95%
Happy 2.1%
Sad 1.4%
Disgusted 0.5%
Confused 0.4%
Angry 0.4%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Male, 96%
Calm 92.9%
Happy 4.6%
Angry 0.8%
Disgusted 0.4%
Confused 0.4%
Surprised 0.4%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 98.6%
Sad 60.1%
Surprised 14.2%
Calm 9.7%
Happy 6.4%
Disgusted 4.9%
Confused 2%
Angry 1.9%
Fear 0.7%

AWS Rekognition

Age 41-49
Gender Male, 79.2%
Calm 99.5%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Happy 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 60.4%
Sad 88%
Confused 5.1%
Calm 2.4%
Disgusted 1.1%
Fear 1.1%
Angry 0.9%
Surprised 0.8%
Happy 0.6%

AWS Rekognition

Age 23-31
Gender Female, 54.7%
Calm 31.8%
Fear 28.3%
Surprised 19.2%
Sad 5.8%
Happy 5.7%
Disgusted 4.4%
Angry 2.9%
Confused 1.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Helmet 56.5%

Captions

Microsoft

a group of people standing in front of a crowd 93.9%
a group of people standing in front of a crowd posing for the camera 91.9%
a group of people standing in front of a crowd of people 91.8%

Text analysis

Amazon

44
2.VE
2.VE CARD
KOBAK
CARD

Google

44
44