Human Generated Data

Title

Untitled (formally dressed men and women seated at table)

Date

c. 1945

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7654

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (formally dressed men and women seated at table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.5
Human 99.5
Person 99.5
Person 99.5
Person 98.9
Person 97.9
Chair 97.2
Furniture 97.2
Person 97.2
Sitting 96.1
Audience 95.7
Crowd 95.7
Person 91.5
Person 81.9
People 76.1
Indoors 74.2
Room 72.6
Person 63.4
Clothing 62.7
Apparel 62.7
Plant 61.2
Blossom 60.7
Flower 60.7
Photography 60.6
Photo 60.6
Text 59.6
Flower Arrangement 59.3
Food 57.2
Meal 57.2
Restaurant 56.4
Cafeteria 56.4
Speech 56.2
Table 55.2

Imagga
created on 2022-01-08

photographer 55.7
person 49.8
patient 47.2
man 41.7
male 37.6
case 35.1
people 33.5
sick person 30.8
adult 24.8
men 22.3
professional 21.7
senior 19.7
medical 19.4
portrait 19.4
work 18.8
businessman 17.6
couple 17.4
worker 16
looking 16
business 15.8
brass 15.1
happy 15
doctor 15
mature 13.9
smiling 13.7
office 13.6
health 13.2
hospital 12.8
occupation 12.8
team 12.5
job 12.4
wind instrument 12.4
group 12.1
mask 11.2
specialist 11.1
women 11.1
room 11
care 10.7
working 10.6
medicine 10.6
human 10.5
love 10.3
nurse 10.2
surgeon 10.2
cornet 9.9
suit 9.9
old 9.8
outdoors 9.7
together 9.6
married 9.6
elderly 9.6
illness 9.5
corporate 9.4
meeting 9.4
camera 9.2
musical instrument 9.2
family 8.9
surgery 8.8
home 8.8
laboratory 8.7
sitting 8.6
research 8.6
businesspeople 8.5
casual 8.5
two 8.5
modern 8.4
manager 8.4
hand 8.4
teamwork 8.3
holding 8.3
technology 8.2
equipment 8.1
handsome 8
science 8
clinic 8
indoors 7.9
happiness 7.8
hands 7.8
face 7.8
uniform 7.8
lab 7.8
colleagues 7.8
retired 7.8
summer 7.7
husband 7.6
biology 7.6
wife 7.6
teacher 7.4
active 7.4
successful 7.3
playing 7.3
confident 7.3
businesswoman 7.3
executive 7.2
weapon 7.1
device 7.1
day 7.1

Google
created on 2022-01-08

White 92.2
Hat 87.5
Coat 85.4
Black-and-white 82.3
Adaptation 79.3
Crew 73.9
Vintage clothing 73.1
Event 71.9
Chair 70
Monochrome photography 69.6
Suit 69.2
Font 68.1
Monochrome 65.5
Recreation 63.9
Art 63.2
Motor vehicle 62.3
Stock photography 62.2
Team 61.9
History 61.4
Photo caption 61

Microsoft
created on 2022-01-08

person 99.6
text 98.4
clothing 90.5
outdoor 88.1
man 87.1
people 61.7
old 40.8
crowd 1.1

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 98.2%
Calm 84.2%
Surprised 7.5%
Happy 3.7%
Sad 1.8%
Confused 1.7%
Disgusted 0.6%
Angry 0.5%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Female, 99.1%
Calm 93.9%
Disgusted 2.9%
Sad 2.1%
Confused 0.3%
Happy 0.2%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.5%
Surprised 40.4%
Sad 39.5%
Confused 6.8%
Fear 3.9%
Angry 2.9%
Disgusted 2.5%
Happy 2.2%
Calm 2%

AWS Rekognition

Age 26-36
Gender Male, 79.5%
Happy 93.7%
Calm 4.4%
Sad 0.8%
Surprised 0.6%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 35-43
Gender Male, 82.5%
Calm 98.2%
Sad 1.5%
Confused 0.1%
Surprised 0.1%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 97.2%

Captions

Microsoft

a group of people posing for a photo 93.9%
a group of people posing for the camera 93.8%
a group of people around each other 93.7%

Text analysis

Amazon

17171.
19171.

Google

.ורירו
.ורירו