Human Generated Data

Title

Untitled (bar mitzvah, Malden, Massachusetts)

Date

1960s, printed later

People

Artist: Samuel Cooper, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1007

Human Generated Data

Title

Untitled (bar mitzvah, Malden, Massachusetts)

People

Artist: Samuel Cooper, American active 1950s

Date

1960s, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.4
Person 99.4
Person 98.9
Person 98.5
Person 96
Person 95
Person 94.5
Apparel 93.2
Coat 93.2
Clothing 93.2
Suit 93.2
Overcoat 93.2
Person 92.8
Person 90.2
Accessories 84.5
Accessory 84.5
Tie 84.5
Crowd 83
People 82.8
Person 82
Tablecloth 64.1
Person 63.9
Person 62.4
Person 62.1
Press Conference 58.7
Advertisement 56.9
Poster 56.9
Person 43.1

Imagga
created on 2021-12-14

man 38.3
businessman 37
male 34
people 32.9
business 32.8
person 31.6
office 31.5
group 24.2
desk 23.7
meeting 23.5
adult 22.8
corporate 22.3
professional 22.1
men 20.6
executive 18.8
room 18.8
happy 18.2
suit 18.1
work 18
team 17.9
laptop 17.6
businesspeople 17.1
computer 17
job 16.8
indoor 16.4
businesswoman 15.4
worker 15.2
manager 14.9
table 14.8
clothing 14.6
handsome 14.3
couple 13.9
colleagues 13.6
indoors 13.2
sitting 12.9
success 12.9
women 12.6
working 12.4
tie 12.3
teamwork 12
looking 12
confident 11.8
groom 11.6
mid adult 11.6
nurse 11.4
portrait 11
successful 11
happiness 11
smiling 10.8
smile 10.7
cheerful 10.6
uniform 10.5
career 10.4
education 10.4
senior 10.3
collaboration 9.8
conference 9.8
partners 9.7
cooperation 9.7
corporation 9.6
together 9.6
jacket 9.6
adults 9.5
two 9.3
communication 9.2
new 8.9
military uniform 8.7
formal 8.6
casual 8.5
modern 8.4
mature 8.4
color 8.3
20s 8.2
attendant 8.2
family 8
student 7.9
associates 7.9
coworkers 7.9
paper 7.8
face 7.8
pretty 7.7
30s 7.7
attractive 7.7
boss 7.6
ethnic 7.6
plan 7.6
pen 7.5
company 7.4
patient 7.2
home 7.2

Google
created on 2021-12-14

Outerwear 95.5
Coat 93.5
Table 83.8
Suit 81.9
Chair 78.3
Formal wear 76.1
Event 74.7
Vintage clothing 73.7
Classic 72.2
Hat 71.8
Monochrome photography 71.3
Monochrome 69.1
Font 68.3
Room 65.4
Family reunion 64
Stock photography 64
Photo caption 63.7
History 63.6
Art 57.1
Retro style 54.3

Microsoft
created on 2021-12-14

text 99.5
person 99.4
clothing 98.9
wall 98.1
posing 97.4
man 94.8
group 85.7
people 80.4
woman 74.1
suit 61.9
smile 58.8
old 56.4
clothes 18.6
crowd 0.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 74.2%
Calm 42.9%
Surprised 34.3%
Happy 17.4%
Angry 1.6%
Confused 1.6%
Disgusted 1.3%
Sad 0.5%
Fear 0.4%

AWS Rekognition

Age 5-15
Gender Female, 92.7%
Calm 54.9%
Sad 42.2%
Angry 1.4%
Happy 0.6%
Fear 0.3%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 10-20
Gender Female, 58.1%
Angry 92.2%
Calm 4.2%
Sad 3%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%
Fear 0%
Surprised 0%

AWS Rekognition

Age 22-34
Gender Female, 82%
Happy 60.2%
Surprised 20.5%
Calm 10.2%
Angry 3.4%
Sad 1.8%
Confused 1.7%
Fear 1.5%
Disgusted 0.7%

AWS Rekognition

Age 16-28
Gender Female, 96.3%
Happy 98.8%
Surprised 0.4%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Calm 0.1%
Sad 0.1%

AWS Rekognition

Age 21-33
Gender Male, 97.4%
Confused 56.4%
Angry 18.5%
Sad 11.8%
Calm 7.8%
Disgusted 3.4%
Happy 0.8%
Fear 0.8%
Surprised 0.6%

AWS Rekognition

Age 23-35
Gender Female, 50.4%
Sad 93%
Confused 5.2%
Calm 1.2%
Angry 0.4%
Fear 0%
Disgusted 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 23-35
Gender Male, 91.8%
Happy 94.4%
Surprised 3.5%
Angry 1.2%
Calm 0.3%
Confused 0.2%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 94.3%
Calm 42%
Sad 37.9%
Confused 16.9%
Angry 1.2%
Fear 0.8%
Surprised 0.7%
Happy 0.3%
Disgusted 0.1%

AWS Rekognition

Age 24-38
Gender Female, 61.4%
Calm 68%
Sad 15.2%
Angry 13.4%
Happy 1.6%
Surprised 0.7%
Disgusted 0.5%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 22-34
Gender Male, 91.3%
Angry 51.5%
Sad 28%
Fear 12.6%
Confused 2.3%
Calm 2.1%
Happy 1.7%
Surprised 1%
Disgusted 0.8%

AWS Rekognition

Age 37-55
Gender Male, 92.4%
Calm 51.1%
Sad 40.6%
Angry 3.3%
Confused 2.1%
Happy 1.7%
Disgusted 0.4%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 18-30
Gender Male, 85.6%
Calm 89.6%
Angry 4.5%
Sad 2.5%
Happy 1.3%
Fear 0.8%
Surprised 0.8%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 17-29
Gender Male, 89.2%
Sad 55.5%
Calm 25.1%
Confused 6.2%
Fear 5.6%
Surprised 3.3%
Angry 2.6%
Disgusted 0.8%
Happy 0.7%

AWS Rekognition

Age 23-35
Gender Male, 87.1%
Calm 69.3%
Sad 10.7%
Confused 8.6%
Angry 4%
Happy 3.4%
Surprised 1.9%
Disgusted 1.4%
Fear 0.8%

AWS Rekognition

Age 39-57
Gender Male, 93.2%
Calm 48.9%
Sad 38.2%
Disgusted 6.4%
Confused 4.2%
Surprised 1.1%
Happy 0.5%
Fear 0.4%
Angry 0.4%

AWS Rekognition

Age 28-44
Gender Female, 61.7%
Sad 90.8%
Calm 5.4%
Fear 2.8%
Angry 0.2%
Confused 0.2%
Surprised 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 13-25
Gender Female, 84.9%
Sad 69.1%
Calm 22.6%
Angry 6.2%
Confused 0.8%
Happy 0.5%
Disgusted 0.3%
Surprised 0.3%
Fear 0.3%

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 43
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Suit 93.2%
Tie 84.5%
Poster 56.9%

Captions

Microsoft

a group of people posing for a photo 98.3%
a group of people posing for the camera 98.2%
a group of people posing for a picture 98.1%

Text analysis

Amazon

68%
33
24)
24) Samuel Cooper Studio
Samuel
Studio
190
Cooper
Massachusetts
16
Brookline Massachusetts
Malden
Brookline
1960's
c. 1960's
c.

Google

24)
Samuel
Malden
33
190
Studio
Massachusetts
1960's
24) Samuel Cooper Studio Braaktine, Massachusetts c. 1960's Malden 33 68% 190
Braaktine,
Cooper
c.
68%