Human Generated Data

Title

Untitled (county fair, central Ohio)
Date

August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2766
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (county fair, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2766

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Sun Hat 100
Photography 100
Face 99.9
Head 99.9
Portrait 99.9
Body Part 99.2
Finger 99.2
Hand 99.2
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Person 99
Adult 99
Male 99
Man 99
Hat 98.9
Person 98.3
Adult 98.3
Male 98.3
Man 98.3
Hat 97.9
Hat 96.5
Person 95.9
Adult 95.9
Male 95.9
Man 95.9
Hat 88.7
Accessories 83.2
Formal Wear 83.2
Tie 83.2
Cap 73.2
Smoke 65
Tie 62.5
Baseball Cap 57.1
Coat 56
People 55.5

Clarifai
created on 2018-05-10

people 99.9
lid 99.1
group 98.9
man 98
group together 96.9
adult 96.9
leader 96.6
veil 96
administration 95
several 93.9
wear 93.4
two 91
many 90.9
three 88
four 86.7
elderly 84.7
five 82.8
portrait 80.8
fedora 78.9
woman 77.6

Imagga
created on 2023-10-05

person 55.6
man 49
farmer 48
male 43.2
senior 31.8
people 29
men 27.5
face 24.8
adult 24
portrait 23.9
old 23.7
scholar 21.4
hat 19.3
marimba 18.6
musical instrument 18.1
worker 17.7
building 17.6
elderly 17.2
intellectual 17.1
percussion instrument 16.7
apiary 15.2
happy 15
construction 14.5
casual 14.4
serious 14.3
outdoors 14.2
work 14.1
hand 13.7
industry 13.6
business 13.3
businessman 13.2
shirt 13.1
guy 12.9
looking 12.8
grandfather 12.5
handsome 12.5
job 12.4
shed 12.1
two 11.8
older 11.6
age 11.4
builder 11.3
site 11.2
old-timer 11.2
mature 11.1
professional 11.1
spectator 11
head 10.9
smiling 10.8
engineer 10.8
lifestyle 10.8
smile 10.7
working 10.6
helmet 10.6
foreman 10.1
beard 9.8
standing 9.6
hair 9.5
expression 9.4
manager 9.3
safety 9.2
outbuilding 9.1
leisure 9.1
aged 9
contractor 8.7
retired 8.7
couple 8.7
architect 8.7
glasses 8.3
clothing 8.2
eye 8
office 8
structure 8
together 7.9
look 7.9
black 7.8
architecture 7.8
outside 7.7
retirement 7.7
occupation 7.3
success 7.2
home 7.2
device 7.1
interior 7.1
happiness 7

Google
created on 2018-05-10

photograph 95.4
man 93.9
black and white 92
monochrome photography 86.3
male 83.4
photography 80.4
monochrome 72.9
headgear 70.8
human behavior 58.7
vintage clothing 55
stock photography 52.7

Microsoft
created on 2018-05-10

outdoor 97.5
old 94.2
man 93.2
person 89.1
older 39.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Angry 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Male, 99.4%
Calm 89.3%
Fear 8.3%
Surprised 7.9%
Sad 2.4%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 48-56
Gender Female, 81.8%
Calm 99.1%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.4%
Confused 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 43-51
Gender Male, 97.3%
Calm 91.2%
Happy 6.9%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Confused 0.4%
Angry 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 72
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 67
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Adult 99.1%
Male 99.1%
Man 99.1%
Hat 98.9%
Tie 83.2%

Categories

Imagga

paintings art 96.2%
people portraits 3.7%

Captions

Microsoft
created on 2018-05-10

an old photo of a man 94.9%
old photo of a man 94%
an old photo of a man in a hat 92.3%