Human Generated Data

Title

Untitled (Jackson Square, New Orleans, Louisiana)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2522
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Jackson Square, New Orleans, Louisiana)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2522

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 99.9
Portrait 99.9
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Clothing 98
Hat 98
Person 97.7
Adult 97.7
Male 97.7
Man 97.7
Smoke 87.9
Beard 77
Mustache 71.1
Sun Hat 57.2
Vest 56.4
Shirt 55.1

Clarifai
created on 2018-05-10

people 99.9
one 99.3
portrait 99.1
man 98.8
adult 98.6
facial hair 98.5
leader 97
wear 96.8
mustache 96
administration 95.6
elderly 94.5
veil 94.2
outfit 93.4
sit 92.9
lid 89.5
writer 89.2
musician 85.6
furniture 83.9
music 81.7
actor 79.4

Imagga
created on 2023-10-06

person 51.5
man 50.4
male 41.2
senior 39.4
portrait 34.9
adult 31.9
old 31.4
people 30.1
scholar 29.5
mature 27.9
elderly 27.8
businessman 24.7
intellectual 24.6
handsome 24.1
face 23.4
looking 23.2
grandfather 23.2
happy 22.6
serious 21.9
glasses 18.5
business 18.2
professional 17.4
lifestyle 17.3
executive 17.1
hair 16.6
retired 16.5
smile 16.4
casual 16.1
smiling 15.9
corporate 14.6
look 14
manager 14
couple 13.9
suit 13.8
older 13.6
human 13.5
work 13.3
happiness 13.3
men 12.9
retirement 12.5
tie 12.3
office 12.2
one 11.9
expression 11.9
love 11.8
head 11.8
pensioner 11.2
shirt 11.2
attractive 11.2
confident 10.9
black 10.8
age 10.5
guy 10.2
hat 10.1
husband 10
aged 10
gray 9.9
life 9.8
grandmother 9.8
success 9.7
together 9.6
beard 9.6
businesspeople 9.5
phone 9.2
alone 9.1
job 8.8
married 8.6
aging 8.6
telephone 8.6
wife 8.5
hand 8.4
joy 8.4
leisure 8.3
emotion 8.3
speaker 8.2
grandma 8
wrinkles 7.9
standing 7.8
depression 7.8
eyes 7.7
outdoor 7.6
marriage 7.6
dark 7.5
close 7.4
successful 7.3
friendly 7.3
cheerful 7.3
eye 7.2

Google
created on 2018-05-10

photograph 95.9
person 93.8
black and white 91.1
facial hair 82.2
gentleman 82.1
monochrome photography 82
snapshot 81.8
photography 79.1
moustache 72.6
portrait 69.7
elder 69.7
human behavior 65.7
vintage clothing 65.3
monochrome 63.5
beard 61.9
stock photography 56.6
senior citizen 50.1

Microsoft
created on 2018-05-10

person 99.7
man 99
old 83.2
older 35.1
crowd 0.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-61
Gender Male, 100%
Sad 98.2%
Calm 40.2%
Surprised 6.4%
Fear 6.1%
Confused 3%
Angry 0.5%
Happy 0.4%
Disgusted 0.4%

AWS Rekognition

Age 49-57
Gender Male, 99.1%
Sad 99.6%
Calm 33.7%
Surprised 6.3%
Fear 5.9%
Confused 0.6%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Adult 99.2%
Male 99.2%
Man 99.2%
Hat 98%

Categories

Imagga

people portraits 50%
paintings art 40.1%
nature landscape 4.9%
beaches seaside 2.9%

Captions

Microsoft
created on 2018-05-10

an old photo of a man 94.6%
a black and white photo of a man 92.7%
old photo of a man 92.6%