Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)
Date

August 6, 1938, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3381
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 6, 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3381

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Hat 99.2
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Hat 98.2
Adult 97.7
Male 97.7
Man 97.7
Person 97.7
Face 93.3
Head 93.3
Cowboy Hat 66.5
Photography 60.8
Portrait 60.8
Smoke 57.8
Hat 55.7

Clarifai
created on 2018-05-10

people 100
lid 99.8
veil 99.1
man 98.4
adult 98.2
two 97.6
three 97.4
elderly 97.1
portrait 95.7
wear 95.6
fedora 94.7
group 94.1
cowboy 93.9
four 92.1
one 91
cowboy hat 90.3
cowman 89.1
mustache 89
retro 87.8
five 86.3

Imagga
created on 2023-10-06

hat 61.9
man 51.7
old-timer 44.1
cowboy hat 42.1
male 41.2
person 34.9
clothing 29.4
people 27.9
portrait 25.9
headdress 25.2
grandfather 24.8
senior 24.4
face 24.1
men 24
adult 20
bow tie 19.6
old 19.5
hand 19
happy 18.2
work 17.3
guy 16.7
necktie 16.6
smile 15.7
uniform 13.8
worker 13.8
elderly 13.4
covering 13.4
look 13.1
shirt 13.1
cowboy 12.9
looking 12.8
expression 12.8
couple 12.2
mature 12.1
black 12
consumer goods 12
casual 11.9
model 11.7
handsome 11.6
smiling 11.6
job 11.5
style 11.1
hair 11.1
beard 11.1
two 11
professional 11
head 10.9
western 10.7
interior 10.6
together 10.5
attractive 10.5
outdoors 10.4
business 10.3
love 10.3
occupation 10.1
one 9.7
home 9.6
happiness 9.4
lifestyle 9.4
safety 9.2
indoor 9.1
fashion 9
garment 9
father 8.9
wearing 8.6
industry 8.5
vintage 8.3
human 8.2
friendly 8.2
pose 8.2
military uniform 8.1
eye 8
family 8
close 8
businessman 7.9
labor 7.8
mysterious 7.8
boys 7.8
affectionate 7.7
husband 7.6
serious 7.6
wife 7.6
dark 7.5
glasses 7.4
equipment 7.4
retro 7.4
teenager 7.3
room 7.3
suit 7.3
aged 7.2
building 7.1
posing 7.1

Google
created on 2018-05-10

photograph 96
black and white 91.7
monochrome photography 84.7
snapshot 81.8
human behavior 81.5
photography 79.2
monochrome 69.4
vintage clothing 64.8
gentleman 57.2
stock photography 55.1
portrait 51.9

Microsoft
created on 2018-05-10

person 98.7
man 96.8
old 96.1
outdoor 96.1
hat 94.2
white 70.7
older 66

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 80.5%
Sad 100%
Confused 13%
Surprised 6.3%
Fear 5.9%
Calm 4.1%
Angry 0.3%
Disgusted 0.2%
Happy 0%

AWS Rekognition

Age 51-59
Gender Male, 99.7%
Calm 53.2%
Angry 44.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.9%
Happy 0.3%
Disgusted 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.2%
Male 99.2%
Man 99.2%
Person 99.2%
Hat 99.2%

Categories

Imagga

paintings art 95%
people portraits 4%

Captions

Microsoft
created on 2018-05-10

a vintage photo of a man wearing a hat 93.6%
an old photo of a man wearing a hat 93.5%
a man wearing a hat 93.4%