Human Generated Data

Title

Untitled (guests having tea and sandwiches)
Date

c. 1950
People

Artist: John Howell, American active 1930s-1960s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21663

Human Generated Data

Title

Untitled (guests having tea and sandwiches)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.6
Human 99.6
Person 99.6
Person 98.1
Person 97.8
Person 97.4
Apparel 90.9
Clothing 90.9
Female 83.2
Musical Instrument 79.6
Musician 79.6
Hat 78.5
Sleeve 73.6
Long Sleeve 73.6
Suit 72.7
Coat 72.7
Overcoat 72.7
Furniture 68.9
Drum 66.6
Percussion 66.6
Woman 66.1
Flower 66
Plant 66
Blossom 66
Indoors 65.4
Girl 62.7
Couch 62.3
Food 59.3
Meal 59.3
Blonde 58.5
Teen 58.5
Kid 58.5
Child 58.5
Flower Arrangement 58.2
Dress 56.5
Living Room 55.9
Room 55.9
Gown 55.3
Fashion 55.3
Evening Dress 55.3
Robe 55.3

Imagga
created on 2022-03-05

business 41.9
corporate 31.8
businessman 31.8
man 31.6
steel drum 30.7
musical instrument 29.6
executive 29.2
adult 29
people 28.4
male 28.3
professional 27.5
office 27.5
person 27.2
percussion instrument 26.7
work 22.7
businesswoman 22.7
men 19.7
modern 19.6
job 19.4
laptop 19.4
indoors 19.3
computer 19.3
teacher 17.6
women 17.4
hall 17.2
businesspeople 17.1
meeting 16.9
group 16.9
entrepreneur 16.8
indoor 16.4
suit 16.2
happy 15.7
worker 15.5
team 15.2
building 14.7
success 14.5
handsome 14.3
career 14.2
mature 13.9
education 13
teamwork 13
smile 12.8
room 12.5
chair 12.4
interior 12.4
working 12.4
manager 12.1
sitting 12
attractive 11.9
communication 11.7
corporation 11.6
desk 11.3
clothing 11.1
occupation 11
20s 11
successful 11
smiling 10.8
lifestyle 10.8
employee 10.7
fashion 10.5
ethnic 10.5
casual 10.2
student 10
holding 9.9
educator 9.7
diversity 9.6
couple 9.6
restaurant 9.4
baron 9.3
company 9.3
finance 9.3
black 9
diverse 8.8
looking 8.8
colleagues 8.7
leader 8.7
table 8.6
day 8.6
boss 8.6
formal 8.6
notebook 8.6
senior 8.4
portrait 8.4
study 8.4
inside 8.3
confident 8.2
technology 8.2
standing 7.8
face 7.8
businessmen 7.8
secretary 7.8
life 7.8
employment 7.7
talking 7.6
tie 7.6
horizontal 7.5
one person 7.5
learning 7.5
glasses 7.4
alone 7.3
color 7.2
home 7.2
architecture 7
together 7

Google
created on 2022-03-05

Black 89.6
Black-and-white 86.3
Window 85.9
Style 84
Chair 82.8
Monochrome photography 76.6
Monochrome 76.1
Event 73.5
Hat 71.4
Vintage clothing 71
Drum 70.6
Curtain 65.6
Room 65.4
Classic 65
Fedora 64.5
Stock photography 63.9
Suit 63
Sun hat 61.5
Sitting 60.8
Conversation 60.7

Microsoft
created on 2022-03-05

person 99.7
clothing 92.5
people 82.4
standing 78.9
group 78.8
woman 64
text 62.2
vase 57.5

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 98.7%
Happy 99.9%
Surprised 0.1%
Fear 0%
Confused 0%
Angry 0%
Calm 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 52-60
Gender Male, 78.5%
Sad 68.3%
Happy 10.3%
Confused 7.4%
Surprised 6.9%
Calm 2.8%
Disgusted 1.8%
Angry 1.2%
Fear 1.1%

AWS Rekognition

Age 52-60
Gender Male, 95.8%
Sad 23.7%
Calm 22.6%
Happy 19.7%
Surprised 19.4%
Confused 6.9%
Disgusted 3.7%
Angry 2.9%
Fear 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 78.5%

Captions

Microsoft

a group of people standing in front of a window 95.2%
a group of people standing around a table 95.1%
a group of people standing next to a window 95%

Text analysis

Amazon

only