Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1136
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1136

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Machine 100
Spoke 100
Adult 99
Male 99
Man 99
Person 99
Male 98.8
Person 98.8
Boy 98.8
Child 98.8
Wheel 96.6
Face 91.2
Head 91.2
Animal 86.2
Livestock 86.2
Mammal 86.2
Sheep 86.2
Wheel 73.6
Outdoors 66.9
Clothing 66.8
Footwear 66.8
Shoe 66.8
Transportation 61.6
Vehicle 61.6
Hat 57.5
Wagon 57.1
Soil 56.1
Nature 55.6
Tire 55.6

Clarifai
created on 2018-05-11

people 100
vehicle 99.7
adult 99.7
transportation system 99.6
man 98.9
two 98.4
group together 97.8
three 97.6
driver 97.1
group 95.7
military 95.1
cavalry 93.7
veil 93.7
four 93.4
seated 92.5
wagon 92.2
one 91.9
wear 91.5
cart 88
sitting 87.7

Imagga
created on 2023-10-06

cart 71.2
carriage 65.5
horse cart 64.7
wagon 52.6
wheeled vehicle 47.2
vehicle 36.3
wheelchair 31.8
old 23.7
outdoors 22.4
chair 19.9
wheel 19.8
barrow 19
man 18.8
park 18.1
transportation 17.9
outdoor 17.6
people 14.5
seat 13.9
handcart 13.6
care 13.2
jinrikisha 13.1
outside 12.8
disabled 12.8
male 12.8
grass 12.7
street 12
transport 11.9
farm 11.6
senior 11.3
help 11.2
landscape 11.2
bicycle 10.7
rural 10.6
travel 10.6
horse 10.5
adult 10.4
sitting 10.3
equipment 9.9
tractor 9.8
building 9.5
field 9.2
city 9.1
leisure 9.1
support 9.1
person 9.1
health 9
summer 9
machine 9
sky 8.9
invalid 8.9
handicapped 8.9
autumn 8.8
bike 8.8
ride 8.7
sick 8.7
antique 8.7
illness 8.6
trees 8
handicap 7.9
disability 7.9
love 7.9
day 7.8
mobility 7.8
architecture 7.8
riding 7.8
machinery 7.8
retired 7.8
retirement 7.7
elderly 7.7
husband 7.6
car 7.6
walking 7.6
tricycle 7.5
happy 7.5
wood 7.5
vacation 7.4
fall 7.2
lifestyle 7.2
family 7.1
wooden 7
country 7

Google
created on 2018-05-11

motor vehicle 93.2
black and white 90.7
mode of transport 87.5
troop 81.6
monochrome photography 76.7
vehicle 74.9
soldier 74.8
militia 71.1
military officer 65.4
war 62.7
monochrome 60.8
military person 58.7
chariot 55.8
wheel 51.6

Microsoft
created on 2018-05-11

outdoor 99.9
man 96.4
person 95.1
transport 66.6
old 62.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 97.4%
Surprised 6.4%
Fear 6%
Sad 2.3%
Confused 0.9%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 39-47
Gender Male, 99.1%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Happy 0%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99%
Male 99%
Man 99%
Person 99%
Boy 98.8%
Child 98.8%
Wheel 96.6%
Sheep 86.2%
Shoe 66.8%

Captions

Microsoft
created on 2018-05-11

a man sitting on a bicycle 73.5%
an old photo of a man 73.4%
old photo of a man 73.3%