Human Generated Data

Title

Untitled (drinking tea around table, Pennsylvania)

Date

1940, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.34

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (drinking tea around table, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Chair 100
Furniture 100
Human 98.9
Person 98.9
Person 97.2
Person 97.2
Couch 96.3
Room 95.7
Indoors 95.7
Person 93.4
Sitting 93.2
Footwear 93.2
Clothing 93.2
Shoe 93.2
Apparel 93.2
Living Room 90
Person 88.1
Restaurant 88
Chair 87.6
Dining Table 84.9
Table 84.9
Flooring 79.6
Person 78
Food 77.2
Meal 77.2
Dining Room 70.9
Floor 70.9
Food Court 67.7
Waiting Room 59.7
Cafeteria 56.5
Dish 55.7
Reception 55.4
Reception Room 55.4

Imagga
created on 2022-01-08

room 41.4
interior 38
table 36.2
chair 30.8
home 29.5
executive 25.3
indoors 22
house 21.7
restaurant 21.4
man 20.8
indoor 19.2
male 19.2
people 19
office 18.3
classroom 18.1
design 18
person 17.8
modern 17.5
dining 17.1
meeting 17
drink 16.7
couple 16.6
food 16.5
furniture 16.4
sitting 16.3
adult 16.2
floor 15.8
inside 15.6
window 15.6
teacher 14.9
dinner 14.7
business 14.6
together 14
kitchen 13.9
women 13.4
team 13.4
wood 13.3
businessman 13.2
contemporary 13.2
happy 12.5
desk 12.5
glass 12.5
decor 12.4
men 12
decorate 11.4
talking 11.4
style 11.1
lifestyle 10.8
lunch 10.8
family 10.7
group 10.5
work 10.4
love 10.3
teamwork 10.2
smiling 10.1
suit 10.1
professional 9.9
educator 9.8
cheerful 9.8
couch 9.7
residential 9.6
sofa 9.6
hotel 9.6
counter 9.5
happiness 9.4
meal 9.3
mature 9.3
waiter 9.3
coffee 9.3
service 9.3
eating 9.3
businesswoman 9.1
plant 9
upscale 8.9
colleagues 8.7
hall 8.7
30s 8.7
corporate 8.6
lamp 8.6
luxury 8.6
building 8.6
wall 8.6
smile 8.6
adults 8.5
eat 8.4
cook 8.2
computer 8.1
stool 8
elementary age 7.9
stove 7.9
day 7.8
laptop 7.8
40s 7.8
student 7.7
comfortable 7.6
workplace 7.6
living 7.6
communication 7.6
relaxation 7.5
senior 7.5
place 7.4
presentation 7.4
holding 7.4
wine 7.4
light 7.4
20s 7.3
clothing 7.3
banquet 7.2
stylish 7.2
color 7.2
bright 7.1
employee 7.1
job 7.1
worker 7.1
architecture 7
seat 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

floor 99.6
table 99.5
indoor 99.3
window 93.2
clothing 93.1
chair 91.7
person 90.3
man 84.5
room 80
family 57.8
furniture 31.9
dining table 9.8

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 100%
Calm 98.9%
Confused 0.4%
Sad 0.3%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 41-49
Gender Female, 99.7%
Confused 71.5%
Calm 14.5%
Sad 4.7%
Happy 4.2%
Surprised 2.4%
Angry 1.2%
Fear 0.8%
Disgusted 0.7%

AWS Rekognition

Age 6-16
Gender Female, 98.8%
Happy 81.1%
Disgusted 11.2%
Calm 1.9%
Sad 1.8%
Fear 1.3%
Angry 1.2%
Confused 1.1%
Surprised 0.4%

AWS Rekognition

Age 35-43
Gender Male, 73.5%
Calm 80%
Happy 16.6%
Confused 0.8%
Surprised 0.7%
Sad 0.6%
Disgusted 0.5%
Fear 0.4%
Angry 0.3%

AWS Rekognition

Age 19-27
Gender Male, 97.9%
Calm 98.9%
Angry 0.4%
Confused 0.3%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 97.7%
Calm 89.7%
Sad 3.7%
Fear 2.7%
Angry 1.6%
Disgusted 0.7%
Surprised 0.7%
Confused 0.6%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Chair 100%
Person 98.9%
Shoe 93.2%

Captions

Microsoft

a group of people sitting at a table in a room 96.9%
a group of people sitting at a table 94.1%
a group of people sitting around a table in a room 94%