Human Generated Data

Title

Untitled (relief family, Lancaster, Ohio)
Date

August 1938, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3368
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (relief family, Lancaster, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3368

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Brick 99.2
Adult 98.9
Female 98.9
Person 98.9
Woman 98.9
Adult 98.9
Person 98.9
Male 98.9
Man 98.9
Person 98.5
Baby 98.5
Furniture 97.3
Chair 93.1
Chair 92.1
Face 88.8
Head 88.8
Photography 88.8
Portrait 88.8
Clothing 82.6
Footwear 82.6
Shoe 82.6
Shoe 72.7
Architecture 62.6
Building 62.6
Housing 62.6
Rocking Chair 62.2
House 57.8
Porch 57.8
Dining Table 57.3
Table 57.3
Shorts 57.1
Sitting 56.6
Indoors 56.4
Restaurant 56.4
Dining Room 56
Room 56
Handrail 55.1
Pants 55

Clarifai
created on 2018-05-10

people 100
adult 99.1
group 99
furniture 98.4
child 98.2
woman 98.1
chair 95.8
two 95.6
seat 95.6
group together 95
three 94.9
man 93.9
sit 93.4
four 92.8
offspring 92.5
recreation 91.6
monochrome 90.6
family 89.8
room 89.6
facial expression 88.5

Imagga
created on 2023-10-06

chair 54.9
wheelchair 41
seat 36.5
man 25.5
barbershop 22.7
furniture 21.3
shop 20.8
person 19.9
male 19.3
family 18.7
adult 18.3
people 17.8
washboard 17.6
happy 16.9
home 16.7
rocking chair 16.7
device 16.1
portrait 14.9
child 14.7
sitting 14.6
lifestyle 14.4
mercantile establishment 14.2
room 12.7
old 12.5
senior 12.2
musical instrument 12
indoors 11.4
black 11.4
fashion 11.3
love 11
casual 11
happiness 11
furnishing 10.6
attractive 10.5
couple 10.4
outdoors 10.4
youth 10.2
indoor 10
park 9.9
care 9.9
retired 9.7
mother 9.6
looking 9.6
boy 9.6
place of business 9.5
day 9.4
smiling 9.4
mature 9.3
bench 9.1
clothing 9.1
cheerful 8.9
interior 8.8
elderly 8.6
cute 8.6
building 8.6
smile 8.5
face 8.5
business 8.5
leisure 8.3
holding 8.2
window 8.2
fun 8.2
teenager 8.2
playing 8.2
children 8.2
parent 8
kid 8
women 7.9
outside 7.7
married 7.7
husband 7.6
house 7.5
teen 7.3
aged 7.2
wheeled vehicle 7.2
kin 7.2
working 7.1
businessman 7.1

Google
created on 2018-05-10

photograph 96.1
black and white 92.7
mammal 92.3
sitting 86.1
standing 84
monochrome photography 83.8
photography 82.4
snapshot 81.8
human behavior 76.5
monochrome 69.5
vintage clothing 60.7
window 60.6
picture frame 59.5
stock photography 52.6

Microsoft
created on 2018-05-10

window 95.6
black 70.9
white 64.5
old 46.6
family 15.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Female, 98.7%
Calm 96.3%
Surprised 6.3%
Fear 5.9%
Sad 3.3%
Confused 0.2%
Angry 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 94.7%
Surprised 6.5%
Fear 6.3%
Sad 2.5%
Happy 1.4%
Disgusted 0.5%
Confused 0.5%
Angry 0.4%

AWS Rekognition

Age 26-36
Gender Female, 99.8%
Calm 86.3%
Angry 11%
Surprised 6.4%
Fear 5.9%
Sad 2.8%
Confused 0.2%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 0-3
Gender Female, 92.6%
Surprised 99.7%
Fear 5.9%
Sad 2.2%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Sad 97.9%
Calm 38.6%
Surprised 6.8%
Fear 6.6%
Confused 1.9%
Angry 1.7%
Disgusted 0.7%
Happy 0.6%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Female
Person
Woman
Male
Man
Baby
Chair
Shoe
Adult 98.9%
Adult 98.9%
Female 98.9%
Person 98.9%
Person 98.9%
Person 98.5%
Woman 98.9%
Male 98.9%
Man 98.9%
Baby 98.5%
Chair 93.1%
Chair 92.1%
Shoe 82.6%
Shoe 72.7%

Categories

Imagga

paintings art 84%
pets animals 9.8%
people portraits 3.9%
interior objects 1.2%

Captions

Microsoft
created on 2018-05-10

a vintage photo of a person 94.4%
a black and white photo of a person 92.9%
a vintage photo of a girl 87.7%