Human Generated Data

Title

Untitled (woman seated at bar with mug)
Date

1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5436
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman seated at bar with mug)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.3
Human 99.3
Furniture 98.7
Face 89.2
Clothing 83.1
Apparel 83.1
Chair 79.8
Portrait 70.6
Photography 70.6
Photo 70.6
Food 67.7
Meal 67.7
Person 67.3
Table 67.1
Restaurant 66
Bed 63.9
Female 62
Dish 58.7
Cafe 58.1
Sleeve 57.7
Dining Table 56.9
Smile 55.5

Imagga
created on 2022-01-23

person 38.3
people 34
adult 32
indoors 29.9
bartender 29
happy 28.2
clinic 25.9
home 25.5
man 24.2
smiling 23.9
male 22.9
shop 21.1
library 21
pharmacist 20.9
sitting 20.6
lifestyle 20.2
smile 20
professional 19.6
laptop 17.5
senior 16.9
computer 16.9
portrait 16.8
scholar 16.8
looking 15.2
work 14.9
education 14.7
child 14.5
health professional 14.4
room 14.2
working 14.1
happiness 14.1
standing 13
mature 13
face 12.8
indoor 12.8
family 12.5
together 12.3
school 11.9
intellectual 11.8
student 11.8
color 11.7
books 11.6
business 11.5
medical 11.5
reading 11.4
cheerful 11.4
office 11.4
store 11.3
one person 11.3
attractive 11.2
book 11.1
mother 10.9
kid 10.6
job 10.6
interior 10.6
worker 10.5
salon 10.5
talking 10.5
sit 10.4
leisure 10
holding 9.9
kitchen 9.8
old 9.8
one 9.7
technology 9.7
hairdresser 9.6
studying 9.6
elderly 9.6
college 9.5
notebook 9.3
study 9.3
horizontal 9.2
health 9
desk 8.9
living room 8.8
homework 8.8
brunette 8.7
couple 8.7
clothing 8.7
day 8.6
exam 8.6
men 8.6
casual 8.5
doctor 8.5
pretty 8.4
domestic 8.3
teacher 8.3
shopping 8.3
20s 8.2
alone 8.2
building 8.2
structure 8.1
father 8.1
table 8.1
mercantile establishment 8.1
childhood 8.1
medicine 7.9
hair 7.9
women 7.9
boy 7.8
seated 7.8
retired 7.8
corporate 7.7
laboratory 7.7
1 7.7
using 7.7
30s 7.7
university 7.7
retail 7.6
writing 7.5
house 7.5
manager 7.5
care 7.4
camera 7.4
inside 7.4
parent 7.3
blond 7.3
cup 7.2

Google
created on 2022-01-23

Smile 92
Gesture 85.3
Style 83.8
Black-and-white 83.8
Adaptation 79.2
Flash photography 77.3
Monochrome photography 73.6
Monochrome 73.6
Art 69.5
Vintage clothing 69.2
Happy 67.4
Photo caption 66.1
Stock photography 64
Sitting 61.6
Room 61.4
Font 59.1
Jewellery 58.6
Portrait 54.4
Photographic paper 54
Glass 51.5

Microsoft
created on 2022-01-23

text 99.7
person 99.4
human face 97.3
indoor 95.9
smile 93.9
clothing 91.9
book 91.4
black and white 64.1

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 99.6%
Happy 90.8%
Calm 7.9%
Sad 0.5%
Confused 0.4%
Surprised 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 7-17
Gender Female, 70.6%
Calm 29.5%
Angry 24.5%
Confused 11%
Happy 9.7%
Surprised 8.2%
Fear 7.7%
Sad 5.7%
Disgusted 3.7%

AWS Rekognition

Age 12-20
Gender Male, 81.4%
Calm 85.5%
Angry 5.9%
Sad 4.9%
Happy 1.8%
Surprised 0.6%
Confused 0.5%
Fear 0.5%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a man and a woman sitting on a table 33%
a man and a woman sitting at a table 32.9%
a person sitting on a table 32.8%

Text analysis

Amazon

1-21197

Google

b-618て
b
-
て
618