Human Generated Data

Title

Untitled (man presenting award to cub scout)
Date

1954
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10427
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man presenting award to cub scout)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.3
Person 99.3
Person 99.1
Person 99
Person 98.2
Person 96.4
Clothing 87.5
Apparel 87.5
Crowd 86.6
Text 85.3
People 67.6
Sitting 66.8
Face 64.4
Press Conference 62.9
Furniture 62.8
Photo 61.1
Photography 61.1
Table 60.8
Indoors 58.7
Room 58.7

Imagga
created on 2022-01-09

man 34.9
people 32.9
barbershop 31
shop 31
person 31
table 29.8
room 26.9
male 24.8
desk 24.5
office 24.5
classroom 23.4
mercantile establishment 22.6
group 22.6
adult 22.2
business 21.8
businessman 21.2
education 20.8
smiling 19.5
team 18.8
class 18.3
women 18.2
happy 18.2
meeting 17.9
teacher 17.3
sitting 17.2
modern 16.8
work 16.5
men 16.3
student 16.3
blackboard 16
place of business 15.2
indoors 14.9
board 14.5
professional 14.3
school 13.6
businesswoman 13.6
computer 13.6
smile 13.5
mature 13
lifestyle 13
cheerful 13
two 12.7
businesspeople 12.3
chair 12.2
corporate 12
communication 11.7
hospital 11.6
executive 11.6
interior 11.5
exam 11.5
happiness 11
indoor 11
worker 10.9
colleagues 10.7
to 10.6
couple 10.4
patient 10.2
teamwork 10.2
casual 10.2
hand 9.9
teaching 9.7
job 9.7
life 9.7
talking 9.5
togetherness 9.4
laptop 9.1
confident 9.1
holding 9.1
portrait 9.1
nurse 9
suit 9
technology 8.9
furniture 8.9
working 8.8
leisure activity 8.8
casual clothing 8.8
home 8.8
together 8.8
discussion 8.8
studying 8.6
workplace 8.6
study 8.4
manager 8.4
color 8.3
kitchen 8.2
mathematics 7.8
boy 7.8
conference 7.8
black 7.8
two people 7.8
college 7.6
establishment 7.6
enjoyment 7.5
coffee 7.4
successful 7.3
salon 7.3
success 7.2
looking 7.2
restaurant 7.1

Google
created on 2022-01-09

Shirt 94.6
Black-and-white 84.4
Style 83.8
Table 81.9
Chair 81.9
Font 77.1
Suit 74
Monochrome photography 73.9
T-shirt 73.8
Monochrome 71.7
Event 71.6
Desk 71.4
Job 67
Room 66.2
Employment 64.4
Curtain 64
Art 63.4
Audio equipment 61.2
Advertising 61
Machine 60.3

Microsoft
created on 2022-01-09

text 99.4
person 96.2
clothing 92.8
man 81.5

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 84%
Happy 65.9%
Calm 13.6%
Sad 7.4%
Fear 3.6%
Confused 3.4%
Angry 2.4%
Disgusted 2.2%
Surprised 1.6%

AWS Rekognition

Age 56-64
Gender Male, 99.9%
Calm 99.2%
Sad 0.3%
Confused 0.2%
Surprised 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 84.9%
Calm 47.3%
Sad 45.7%
Happy 2.8%
Surprised 2.2%
Disgusted 0.7%
Confused 0.6%
Angry 0.4%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

website 36.6%

Text analysis

Amazon

34
PACK 34
PACK
FLORI
CUB
CUB SCOUTS
SCOUTS
43072
LION
UNIT
WEBELOS
19
SARAS
A, FLORI
A,
HONOR UNIT
IEN
A
di
HONOR
S
B S A
di ROUKOUP
-
B
ROUKOUP
Height -
Height

Google

PACK 34 aOR U CUB SCOUTS BSA WEBELOS LION SARAS A, FLORI 43072 MJI7--YT3A2--Aa
PACK
CUB
SCOUTS
SARAS
aOR
LION
43072
U
WEBELOS
A,
MJI7--YT3A2--Aa
34
BSA
FLORI