Human Generated Data

Title

Untitled (children around table at birthday party)
Date

c. 1960
People

Artist: John Howell, American active 1930s-1960s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21617

Human Generated Data

Title

Untitled (children around table at birthday party)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.3
Human 99.3
Workshop 99
Person 98.5
Person 98.2
Person 96.8
Room 96.2
Indoors 96.2
Person 95
Person 92.4
Person 90.7
Person 89.9
People 85.7
Person 83.3
Crowd 79.9
Person 79.6
Classroom 78.2
School 78.2
Person 72.5
Female 71.7
Face 70
Furniture 67.2
Clothing 66.1
Apparel 66.1
Person 65.9
Portrait 64.7
Photo 64.7
Photography 64.7
Girl 60.9
Cafeteria 60
Restaurant 60
Building 57.9
Dining Room 55.8
Chair 55.6
Audience 55.1
Person 48.7

Imagga
created on 2022-03-05

room 43.9
classroom 36.7
nurse 36.4
people 30.7
male 28.3
man 28.2
table 27.8
business 27.3
meeting 25.4
office 24.9
person 24.7
group 24.2
businessman 22.9
work 22
indoors 21.9
team 20.6
chair 20
businesswoman 20
men 19.7
interior 19.4
happy 17.5
job 16.8
together 16.6
working 15.9
colleagues 15.5
modern 15.4
desk 15.2
corporate 14.6
adult 14.6
restaurant 14
teamwork 13.9
hall 13.7
worker 13.5
businesspeople 13.3
sitting 12.9
laptop 12.9
executive 12.2
education 12.1
manager 12.1
conference 11.7
30s 11.5
teacher 11.3
indoor 10.9
communication 10.9
glass 10.9
board 10.8
professional 10.6
presentation 10.2
planner 10.2
smiling 10.1
building 10.1
uniform 10
equipment 9.9
40s 9.7
discussion 9.7
new 9.7
computer 9.6
talking 9.5
women 9.5
device 9.4
floor 9.3
suit 9
machine 8.9
class 8.7
busy 8.7
lifestyle 8.7
diversity 8.6
workplace 8.6
smile 8.5
life 8.4
dinner 8.4
inside 8.3
success 8
discussing 7.9
diverse 7.8
seat 7.6
dining 7.6
cafeteria 7.6
plan 7.6
learning 7.5
mature 7.4
occupation 7.3
successful 7.3
meal 7.3
staff 7.3
employee 7.1
clothing 7

Google
created on 2022-03-05

Black-and-white 86.4
Chair 85.9
Style 83.9
Window 83.3
Monochrome photography 77
Monochrome 76.3
Event 73
Crowd 71.3
Suit 70.6
Room 70.1
Art 68.8
History 63.6
Stock photography 63
Team 62.3
Vintage clothing 54.8
Font 53.9
Musician 53.5
Table 52.9
T-shirt 51
Visual arts 50.2

Microsoft
created on 2022-03-05

person 93.3
clothing 91.6
text 81.6
black and white 67.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 98.2%
Calm 92.9%
Sad 4.7%
Happy 0.6%
Surprised 0.5%
Confused 0.5%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Male, 51.4%
Calm 96.9%
Surprised 2.3%
Sad 0.3%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 30-40
Gender Male, 87.8%
Calm 70.6%
Sad 18.7%
Disgusted 4.7%
Angry 3.1%
Confused 1.3%
Happy 0.7%
Fear 0.6%
Surprised 0.4%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 42.1%
Sad 28.7%
Surprised 11.1%
Disgusted 5.3%
Angry 4.7%
Confused 3.9%
Fear 2.1%
Happy 2%

AWS Rekognition

Age 10-18
Gender Male, 96.8%
Happy 42%
Calm 31.1%
Sad 14.3%
Angry 7.9%
Confused 2%
Surprised 1.3%
Disgusted 1.1%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Male, 99.6%
Calm 97.5%
Sad 1.4%
Surprised 0.3%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 40-48
Gender Male, 59.4%
Happy 76.8%
Calm 19%
Sad 1.3%
Surprised 0.9%
Disgusted 0.7%
Angry 0.6%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Sad 42.4%
Calm 37.9%
Fear 6.4%
Confused 6.1%
Disgusted 2.6%
Happy 2.2%
Angry 1.5%
Surprised 0.9%

AWS Rekognition

Age 25-35
Gender Male, 65%
Calm 58.8%
Sad 27.9%
Happy 8.9%
Confused 2.4%
Surprised 0.8%
Disgusted 0.5%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 93.2%
Sad 76.2%
Calm 12.6%
Fear 2.5%
Happy 2.1%
Disgusted 1.9%
Angry 1.6%
Confused 1.6%
Surprised 1.4%

AWS Rekognition

Age 29-39
Gender Female, 67.3%
Sad 81.8%
Calm 17.6%
Happy 0.2%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 36-44
Gender Female, 59.6%
Calm 98.3%
Sad 1.4%
Confused 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 86.4%
Sad 47.3%
Happy 20.8%
Calm 18.7%
Confused 5.2%
Surprised 4%
Angry 1.7%
Fear 1.1%
Disgusted 1.1%

AWS Rekognition

Age 41-49
Gender Female, 56.7%
Calm 98.1%
Sad 0.7%
Happy 0.3%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 40-48
Gender Male, 85%
Calm 98.3%
Sad 1.4%
Confused 0.2%
Happy 0.1%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Chair 55.6%

Captions

Microsoft

a group of people standing in front of a window 83%
a group of people standing in front of a building 82.9%
a group of people sitting in front of a building 82.8%

Text analysis

Amazon

KODAK-
ra
KODAK- SVEETA
SVEETA