Human Generated Data

Title

Untitled (people seated in a room with a large fireplace, Fountain House Inn, D
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11931
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (people seated in a room with a large fireplace, Fountain House Inn, D

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11931

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Workshop 99.5
Person 98.9
Human 98.9
Person 98.4
Person 98.1
Person 98.1
Person 96.2
Person 95.8
Person 95.5
Person 92.6
Interior Design 90.4
Indoors 90.4
Person 90.3
Person 87.3
Meal 85.7
Food 85.7
Helmet 84.2
Clothing 84.2
Apparel 84.2
Person 84.1
Helicopter 73.2
Transportation 73.2
Vehicle 73.2
Aircraft 73.2
Restaurant 72.8
Room 71.5
Furniture 70.2
Table 68.4
Person 65.9
Dish 65.9
People 60.3
Chair 59.2
Cafeteria 58.2
Machine 57.1

Clarifai
created on 2023-10-25

people 99.9
many 99.2
group 98.7
group together 98.2
adult 96.8
man 95.6
woman 94.2
music 92.7
vehicle 91.9
furniture 91.8
recreation 91.2
several 91.1
monochrome 91.1
chair 90.8
child 90.8
crowd 87.8
military 86.3
administration 85.2
wear 84.6
war 82.1

Imagga
created on 2022-01-15

musical instrument 18.3
industrial 16.3
building 16.2
people 16.2
man 16.1
city 15.8
passenger 14.9
factory 14.5
urban 14
industry 13.7
male 13.5
brass 13.4
stage 12.8
business 12.7
wind instrument 12.6
architecture 12.5
trombone 12.3
men 12
silhouette 11.6
percussion instrument 11.5
adult 10.6
travel 10.5
group 10.5
person 10.4
power 10.1
transportation 9.9
metal 9.6
crowd 9.6
structure 9.4
work 9.4
inside 9.2
construction 8.5
old 8.4
entertainment 8.3
center 8.3
music 8.2
performer 8.2
water 8
color 7.8
concert 7.8
nuclear 7.7
party 7.7
modern 7.7
life 7.7
sky 7.6
engineering 7.6
tourism 7.4
protection 7.3
danger 7.3
night 7.1
steel 7.1
indoors 7
equipment 7

Google
created on 2022-01-15

Photograph 94.2
White 92.2
Black 89.6
Black-and-white 86.3
Style 84.1
Chair 78.6
Monochrome 77.8
Monochrome photography 77.8
Snapshot 74.3
Building 72.5
Event 71.4
Room 69
Stock photography 66.9
History 62.6
Art 62.3
Machine 61.7
Illustration 58.6
Table 55.5
Crowd 55.5
Suit 53.7

Microsoft
created on 2022-01-15

person 97
text 95.8
black and white 94.8
indoor 87.7
clothing 84.5
man 80.7
table 60
monochrome 57.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 97.6%
Fear 22.6%
Calm 20.6%
Sad 18.5%
Happy 16.9%
Surprised 7.8%
Confused 5.8%
Disgusted 5.2%
Angry 2.5%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Calm 93.8%
Surprised 2%
Sad 2%
Confused 0.8%
Happy 0.7%
Disgusted 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Male, 98.2%
Calm 67.1%
Sad 12.1%
Fear 6.8%
Surprised 5.5%
Disgusted 4.9%
Happy 1.8%
Confused 1.2%
Angry 0.8%

AWS Rekognition

Age 24-34
Gender Male, 97.3%
Calm 65.2%
Sad 29.1%
Happy 2.3%
Confused 1.2%
Fear 0.7%
Angry 0.6%
Disgusted 0.6%
Surprised 0.4%

AWS Rekognition

Age 12-20
Gender Male, 86.4%
Calm 97%
Fear 1.5%
Angry 0.4%
Disgusted 0.4%
Sad 0.3%
Surprised 0.2%
Confused 0.1%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Helmet 84.2%
Helicopter 73.2%

Captions

Microsoft
created on 2022-01-15

a group of people in a room 93.4%
a group of people in a kitchen 87.8%
a group of people standing in a room 87.7%

Text analysis

Amazon

MJI7
MJI7 A7JA
A7JA
asan

Google

HE YT3JA2 A TJA
HE
YT3JA2
A
TJA