Human Generated Data

Title

Untitled (Mr. Kollar, Hungarian miner, Calumet, Pennsyvania)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1287
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Mr. Kollar, Hungarian miner, Calumet, Pennsyvania)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1287

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Face 99.9
Head 99.9
Photography 99.9
Portrait 99.9
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Hat 94.8
Sun Hat 82.6
Outdoors 79.1
Body Part 65.3
Finger 65.3
Hand 65.3
Coat 57.5
Toy 57.4
Cowboy Hat 55.1

Clarifai
created on 2018-05-11

people 100
adult 99.7
one 99.4
two 99.2
veil 98.2
portrait 98.2
wear 98.2
lid 97
man 96.9
group 94.3
woman 94.2
facial expression 94.1
three 92.7
administration 92.5
outfit 91.3
furniture 89.9
sit 89.4
actor 89.2
music 88.8
group together 85.9

Imagga
created on 2023-10-06

man 37.6
person 35.8
male 29.8
wind instrument 24.2
harmonica 23.5
people 23.4
adult 21.5
weapon 20.7
face 19.9
musical instrument 19.7
free-reed instrument 19
portrait 18.1
men 18
engineer 17.8
job 17.7
hat 17.3
work 16.5
worker 16
professional 14.6
human 13.5
lifestyle 13
hand 12.9
serious 12.4
working 12.4
safety 12
one 11.9
old 11.8
looking 11.2
home 11.2
health 11.1
uniform 11.1
business 10.9
head 10.9
model 10.9
handsome 10.7
happy 10.7
instrument 10.6
medical 10.6
doctor 10.3
hair 10.3
occupation 10.1
confident 10
flute 9.9
holding 9.9
labor 9.7
skill 9.6
black 9.6
senior 9.4
gun 9.4
student 9.3
device 9.3
smile 9.3
glasses 9.3
active 9
bow 8.8
building 8.7
smiling 8.7
exam 8.6
casual 8.5
fashion 8.3
vintage 8.3
clothing 8.3
care 8.2
retro 8.2
woodwind 8.1
businessman 7.9
helmet 7.9
indoors 7.9
look 7.9
construction 7.7
attractive 7.7
industry 7.7
equipment 7.7
profession 7.7
teenager 7.3
protection 7.3
coat 7.2
world 7.2
medicine 7

Google
created on 2018-05-11

photograph 96.1
black and white 90.3
snapshot 81.8
monochrome photography 79.4
photography 78.9
standing 77.9
vintage clothing 73.9
monochrome 63.7
gentleman 61.3
human behavior 58.6
stock photography 54.6

Microsoft
created on 2018-05-11

person 98.2
window 92.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 97.3%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Angry 0.7%
Happy 0.1%
Confused 0.1%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Adult 99.4%
Male 99.4%
Man 99.4%
Hat 94.8%

Categories

Imagga

people portraits 52.9%
pets animals 26.1%
paintings art 11.9%
food drinks 4.4%
interior objects 4%