Human Generated Data

Title

Untitled (five men, including Joe Steinmetz, in Steinmetz studio)
Date

1949
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5622
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (five men, including Joe Steinmetz, in Steinmetz studio)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.5
Person 99.5
Person 99.5
Person 98.9
Person 97
Person 96.7
Chair 96.5
Furniture 96.5
Game 82.4
Person 74.3
People 61.3
Chess 59.8
Chair 57.8
Footwear 55.8
Shoe 55.8
Clothing 55.8
Apparel 55.8

Imagga
created on 2021-12-15

product 19.9
creation 16.9
table 16.1
business 15.2
magazine 15
hand 14.4
blackboard 14.4
technology 14.1
work 14.1
container 11.8
negative 11.8
plan 11.3
interior 10.6
decoration 10.2
tray 10.2
person 10.1
man 10.1
people 10
human 9.7
film 9.7
collage 9.6
design 9.6
desk 9.6
map 9.3
3d 9.3
adult 9.2
house 9.2
health 9
newspaper 9
working 8.8
medical 8.8
celebration 8.8
modern 8.4
receptacle 8.3
paper 8.3
world 8.2
global 8.2
furniture 8.2
digital 8.1
medicine 7.9
appliance 7.8
education 7.8
empty 7.7
setting 7.7
planning 7.7
keyboard 7.6
sign 7.5
dishwasher 7.5
home appliance 7.5
symbol 7.4
sketch 7.4
device 7.3
indoor 7.3
data 7.3
computer 7.2
equipment 7.2
holiday 7.2
idea 7.1
science 7.1
professional 7

Google
created on 2021-12-15

Chair 84.7
Naval architecture 84.6
Motor vehicle 83.9
Font 73
Engineering 72.4
Machine 71.2
Monochrome 67.5
Monochrome photography 65.6
Automotive design 62.5
Art 62.1
Room 62.1
Sitting 60.4
Advertising 56.1
Employment 51.8

Microsoft
created on 2021-12-15

text 99.7
person 94.1
clothing 88.4
black and white 69
chair 66.6
furniture 56.7
drawing 52.1
old 47
posing 46.7

Face analysis

Amazon

Google

AWS Rekognition

Age 49-67
Gender Female, 68.2%
Calm 91.6%
Sad 6.4%
Confused 0.6%
Surprised 0.5%
Happy 0.4%
Angry 0.3%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 26-40
Gender Male, 69.5%
Sad 46.1%
Calm 39.3%
Fear 7.5%
Happy 3.3%
Surprised 1.8%
Confused 1%
Angry 0.8%
Disgusted 0.2%

AWS Rekognition

Age 46-64
Gender Male, 59.1%
Calm 83.7%
Happy 11.4%
Sad 2.5%
Angry 1%
Confused 0.5%
Fear 0.4%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 20-32
Gender Male, 94.3%
Calm 99.2%
Sad 0.3%
Happy 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 25-39
Gender Male, 77.5%
Calm 86.9%
Sad 10.9%
Happy 1.5%
Confused 0.5%
Surprised 0.1%
Angry 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 96.5%
Shoe 55.8%

Captions

Microsoft

a group of people posing for a photo 79.5%
a group of people standing in front of a window 73.6%
a group of people posing for the camera 73.5%

Text analysis

Amazon

FLORIDA
SARASOTA,
STEINMETZ,
STEINMETZ, SARASOTA, FLORIDA 25397.
25397
25397.
EVEEU
ROUVR

Google

25397.
25397. STEINMETZ, SARASOTA, FLORIDA 25 3 97.
STEINMETZ,
FLORIDA
SARASOTA,
25
3
97.