Human Generated Data

Title

Untitled (women from EA Corps. at table with food)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4488

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (women from EA Corps. at table with food)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.1
Human 99.1
Chair 98.8
Furniture 98.8
Chair 98.2
Person 98.1
Person 98
Person 95.9
Room 95.3
Indoors 95.3
Person 94
Workshop 83.1
Person 81.5
People 78.9
Chair 73.9
Person 73
Person 70.4
Person 60.3
School 58.9
Classroom 58.9
Bedroom 58.8
Crowd 57
Clinic 56.8
Table 56.4
Person 51.2

Imagga
created on 2022-01-23

salon 41.9
barbershop 40.2
shop 37.5
room 34.8
table 33.8
chair 28.9
restaurant 26.7
mercantile establishment 25
classroom 24
people 20.6
interior 20.3
blackboard 20.3
business 18.2
man 18.1
hall 17.3
place of business 16.7
furniture 15.9
cafeteria 15.9
indoors 15.8
male 15.6
glass 14.8
person 14.5
modern 14
dinner 13.6
work 13.5
office 12.9
design 12.9
men 12.9
chairs 12.7
urban 12.2
group 12.1
party 12
seat 11.3
empty 11.2
floor 11.2
adult 10.9
tables 10.8
dining 10.5
desk 10.4
building 10.2
day 10.2
worker 9.9
meal 9.8
decor 9.7
businessman 9.7
sitting 9.4
meeting 9.4
decoration 9.4
lifestyle 9.4
city 9.1
board 9.1
team 9
teacher 8.9
boy 8.7
setting 8.7
comfortable 8.6
architecture 8.6
food 8.5
drink 8.4
inside 8.3
establishment 8.3
light 8
structure 8
scene 7.8
student 7.7
lunch 7.7
luxury 7.7
class 7.7
life 7.6
elegance 7.6
happy 7.5
outdoors 7.5
study 7.5
event 7.4
wine 7.4
women 7.1
family 7.1
medical 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 98.2
chair 95.2
table 95.1
furniture 92.1
black and white 88.5
drawing 60.5

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 99.8%
Calm 86%
Sad 4.8%
Surprised 4%
Angry 2.2%
Happy 1%
Confused 1%
Fear 0.7%
Disgusted 0.4%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Calm 98.8%
Sad 1.1%
Confused 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 98.4%
Calm 69.4%
Sad 23.9%
Confused 4.1%
Surprised 1.2%
Angry 0.4%
Disgusted 0.4%
Fear 0.3%
Happy 0.3%

AWS Rekognition

Age 30-40
Gender Male, 75.8%
Sad 57.6%
Happy 18%
Calm 11.8%
Confused 4.8%
Surprised 2.9%
Fear 1.9%
Disgusted 1.5%
Angry 1.3%

AWS Rekognition

Age 45-51
Gender Female, 99.4%
Calm 99.6%
Sad 0.1%
Happy 0.1%
Surprised 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Female, 54.8%
Calm 63.9%
Sad 30.1%
Confused 3.9%
Disgusted 1%
Angry 0.5%
Happy 0.2%
Fear 0.2%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Chair 98.8%

Captions

Microsoft

a group of people in a room 92%
a group of people standing in a room 87.9%
a group of people around each other 74.3%

Text analysis

Amazon

AIDES
BAR
EA
SANDWICH BAR
SANDWICH
21422
21422,
ENCY AL
DEL ENCY AL
the
DEL

Google

EA
AIDES
SANDWICH BAR EA AIDES
SANDWICH
BAR