Human Generated Data

Title

Untitled (bar mitzvah)

Date

1950

People

Artist: Samuel Cooper, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19561

Human Generated Data

Title

Untitled (bar mitzvah)

People

Artist: Samuel Cooper, American active 1950s

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.1
Person 99.1
Clothing 98.6
Apparel 98.6
Person 98.4
Person 97.5
Person 97.2
Person 97
Person 92.3
Person 88.3
Overcoat 88.1
Suit 88.1
Coat 88.1
Face 87.8
Female 85.4
Dress 85.1
People 83
Person 77.1
Person 69
Woman 67.8
Photography 65.8
Photo 65.8
Portrait 64.9
Girl 61.5
Text 61
Plant 57.7
Blossom 57.7
Flower 57.7
Advertisement 55.5
Crowd 55.1

Imagga
created on 2022-03-05

man 34.3
people 32.9
male 31.2
person 29
musical instrument 28
adult 27.8
business 22.5
men 19.7
couple 18.3
wind instrument 18
professional 17.2
black 16.4
corporate 16.3
group 16.1
businessman 15
indoors 14.9
face 14.9
executive 14.1
office 13
mature 13
portrait 12.9
sitting 12.9
handsome 12.5
concertina 12.4
businesspeople 12.3
indoor 11.9
clothing 11.8
happy 11.3
senior 11.2
looking 11.2
women 11.1
casual 11
percussion instrument 10.9
lifestyle 10.8
silhouette 10.8
holding 10.7
free-reed instrument 10.7
hand 10.6
job 10.6
kin 10.4
career 10.4
home 10.4
meeting 10.4
work 10.2
suit 9.9
restaurant 9.9
team 9.8
attractive 9.8
old 9.7
accordion 9.7
crowd 9.6
device 9.6
adults 9.5
musician 9.4
happiness 9.4
clothes 9.4
music 9.2
communication 9.2
businesswoman 9.1
fashion 9
human 9
cheerful 8.9
room 8.8
teacher 8.8
together 8.8
corporation 8.7
smiling 8.7
table 8.6
smile 8.5
employee 8.5
modern 8.4
window 8.2
laptop 8.2
confident 8.2
dress 8.1
success 8
night 8
60s 7.8
marimba 7.7
spectator 7.7
formal 7.6
two 7.6
horizontal 7.5
singer 7.5
fun 7.5
performer 7.5
leisure 7.5
glasses 7.4
20s 7.3
alone 7.3
aged 7.2
color 7.2
love 7.1
life 7.1

Google
created on 2022-03-05

Style 83.8
Vintage clothing 75.8
Monochrome 75.5
Hat 73.4
Event 71.7
Monochrome photography 70.5
Room 69.7
Classic 68.8
Art 67.9
Font 67.4
History 64.8
Stock photography 63.6
Team 61.5
Cooking 59.1
Crew 56.5
Uniform 54.1
Retro style 52.4

Microsoft
created on 2022-03-05

person 99.2
clothing 95.4
text 94.3
outdoor 90.7
man 90.5
standing 87.8
woman 85.4
black and white 79
dress 63.1
people 59.6
smile 59.1
posing 51.9
sketch 51.5

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 96.1%
Surprised 2.5%
Confused 0.8%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%
Happy 0.1%
Sad 0%

AWS Rekognition

Age 35-43
Gender Male, 99.6%
Sad 33.6%
Disgusted 28.5%
Calm 16.4%
Confused 10.2%
Angry 3.5%
Surprised 3.4%
Happy 2.8%
Fear 1.6%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 35.1%
Surprised 34.3%
Confused 21.3%
Sad 3.4%
Disgusted 1.7%
Angry 1.6%
Happy 1.4%
Fear 1.2%

AWS Rekognition

Age 30-40
Gender Female, 90.1%
Calm 93.2%
Surprised 2.7%
Sad 1.5%
Happy 1.2%
Angry 0.5%
Confused 0.3%
Fear 0.3%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people posing for a photo 95.4%
a group of people posing for a picture 95.3%
a group of people posing for the camera 95.2%

Text analysis

Amazon

11
is
FF is
FF