Human Generated Data

Title

Untitled (young men and women sitting on sofas reading; mantle with picture of FDR)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5163
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (young men and women sitting on sofas reading; mantle with picture of FDR)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5163

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 97.5
Apparel 97.5
Person 97.4
Human 97.4
Person 97
Person 93.4
Face 82.2
People 78.3
Person 76.5
Person 72.1
Bed 71.4
Furniture 71.4
Female 67.3
Person 67.1
Shorts 65.9
Person 64.7
Portrait 63.5
Photography 63.5
Photo 63.5
Indoors 60.9
Room 58

Clarifai
created on 2023-10-26

people 99.8
group 99.3
adult 98.2
man 97.7
woman 97.3
group together 96
child 91.9
several 91.7
medical practitioner 91.5
sit 91
actress 90.5
three 90.3
furniture 90.2
many 88
four 88
actor 86.5
music 85.9
chair 85.3
administration 84.8
five 84.4

Imagga
created on 2022-01-23

person 37.3
man 37
nurse 32.9
people 31.8
businessman 30.9
male 30.5
professional 28.8
business 27.3
work 25.9
office 25.8
adult 24
businesspeople 22.8
working 20.3
team 19.7
job 19.5
corporate 18.9
meeting 18.8
worker 18.7
computer 17.6
teamwork 17.6
patient 17.5
businesswoman 17.3
group 16.9
medical 15.9
laptop 15.5
room 15.2
doctor 15
sitting 14.6
happy 14.4
desk 14.2
indoors 14
manager 14
men 13.7
teacher 13.6
coat 13.5
colleagues 12.6
smiling 12.3
jacket 12.2
executive 12.1
looking 12
home 12
specialist 11.9
successful 11.9
technology 11.9
indoor 11.9
handsome 11.6
lab coat 11.4
education 11.3
table 11.2
portrait 11
occupation 11
suit 10.8
lab 10.7
student 10.6
medicine 10.6
case 10.5
clinic 10.2
holding 9.9
modern 9.8
conference 9.8
health 9.7
cooperation 9.7
together 9.6
couple 9.6
color 9.5
plan 9.4
communication 9.2
clothing 9.2
confident 9.1
human 9
brass 8.8
laboratory 8.7
test 8.7
serious 8.6
talking 8.5
career 8.5
two 8.5
attractive 8.4
company 8.4
cornet 8
engineer 7.9
women 7.9
associates 7.9
scientist 7.8
discussion 7.8
chemistry 7.7
project 7.7
formal 7.6
casual 7.6
development 7.6
hand 7.6
tie 7.6
equipment 7.5
presentation 7.4
20s 7.3
new 7.3
educator 7.2
hospital 7.2
bright 7.1
smile 7.1
idea 7.1
science 7.1
face 7.1
book jacket 7
wind instrument 7

Google
created on 2022-01-23

Black 89.6
Black-and-white 84.6
Style 84.1
T-shirt 78.3
Monochrome photography 74.3
Monochrome 72.9
Event 70.8
Vintage clothing 67.9
Room 65.8
Font 64.8
Stock photography 64.1
Fun 63.5
Art 62.9
Sitting 60.8
Service 55
Child 50.6

Microsoft
created on 2022-01-23

text 98.7
person 80.8
clothing 73
drawing 72.8
man 68.7
cartoon 55.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 94.4%
Calm 97.8%
Sad 1.9%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 99.6%
Calm 81.3%
Happy 10.2%
Surprised 3%
Sad 2.6%
Confused 2%
Disgusted 0.4%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 41-49
Gender Female, 86.3%
Calm 95.6%
Sad 1.8%
Happy 1%
Surprised 0.6%
Fear 0.6%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Female, 88.2%
Happy 92.1%
Calm 6.2%
Surprised 0.6%
Angry 0.3%
Sad 0.3%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Female, 79.3%
Happy 80.7%
Calm 10.6%
Sad 2.4%
Fear 2.4%
Confused 1.4%
Disgusted 1.2%
Surprised 0.9%
Angry 0.4%

AWS Rekognition

Age 30-40
Gender Male, 99.1%
Calm 58.4%
Surprised 15.6%
Confused 11%
Fear 8%
Sad 2.5%
Disgusted 2.3%
Angry 1.6%
Happy 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%

Categories

Imagga

people portraits 46.5%
paintings art 30.8%
interior objects 19.2%
pets animals 1.4%

Captions

Text analysis

Amazon

14923
WITH
WIN WITH
WIN
ROOSEVELT
FRANKLIN
14923.
PRESIDENT
O
DON NEWS

Google

14923 14923. 10
14923
14923.
10