Human Generated Data

Title

Sideshow, county fair, central Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2999

Human Generated Data

Title

Sideshow, county fair, central Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.2
Person 99.2
Person 98.6
Person 95.4
Person 92.7
Bus Stop 92.2
Person 88.5
Person 87.7
Person 85.6
Kiosk 77.7
Person 75.1
Painting 67.1
Art 67.1
Person 66.5
Shop 58.8
Text 55.7

Imagga
created on 2021-12-15

stall 37.3
upright 27.4
old 24.4
piano 21.4
architecture 18.7
building 18.5
house 16.7
percussion instrument 16.6
stringed instrument 16.3
keyboard instrument 16.3
wall 15
door 13.5
structure 12.9
window 12.8
vintage 12.4
scene 12.1
ancient 12.1
musical instrument 11.9
room 11.7
industry 11.1
city 10.8
antique 10.5
construction 10.3
industrial 10
container 9.9
travel 9.9
history 9.8
abandoned 9.8
broken 9.6
urban 9.6
roof 9.5
stone 9.5
light 9.4
toilet 9.1
dirty 9
home 8.8
temple 8.5
grunge 8.5
outdoor 8.4
street 8.3
vehicle 8.2
retro 8.2
religion 8.1
shop 7.9
rural 7.9
black 7.8
factory 7.7
brick 7.5
wood 7.5
ashcan 7.5
town 7.4
work 7.2
metal 7.2
aged 7.2
transportation 7.2
barbershop 7.1
sky 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

clothing 94
text 93.7
person 90.5
photograph 60.1
store 47.6

Face analysis

Amazon

Google

AWS Rekognition

Age 27-43
Gender Male, 96.2%
Calm 27.2%
Sad 24.6%
Happy 18.2%
Confused 11.9%
Disgusted 7.2%
Fear 4.7%
Surprised 3.7%
Angry 2.5%

AWS Rekognition

Age 37-55
Gender Female, 62%
Happy 99.8%
Calm 0.1%
Surprised 0%
Angry 0%
Fear 0%
Disgusted 0%
Sad 0%
Confused 0%

AWS Rekognition

Age 22-34
Gender Male, 93%
Calm 66.8%
Confused 22.2%
Angry 5.8%
Sad 2.9%
Disgusted 0.9%
Surprised 0.5%
Happy 0.5%
Fear 0.3%

AWS Rekognition

Age 21-33
Gender Female, 78.1%
Sad 61%
Calm 29.9%
Confused 3.6%
Surprised 2.1%
Happy 1.5%
Angry 1.3%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 24-38
Gender Male, 67.5%
Angry 54.2%
Fear 20.1%
Calm 15.3%
Sad 5.1%
Happy 2.5%
Confused 1.3%
Surprised 0.8%
Disgusted 0.7%

AWS Rekognition

Age 7-17
Gender Male, 76.2%
Calm 93.9%
Happy 3.2%
Sad 1.1%
Angry 1%
Confused 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 67.1%

Captions

Microsoft

a vintage photo of a dog in front of a store 50%
a vintage photo of a store 49.9%
a vintage photo of a dog that is standing in front of a store 42.5%

Text analysis

Amazon

GIRL
PERSO
FAT
MORE
PERSO NALITY FAT GIRL
IT
JUST
ONE
WILL
NALITY
CLOTH
MAKE IT
MAKE
BOLT JUST WILL ONE OF MORE CLOTH
10<
OF
CHI
se
CHI ДЕГЬ
BOLT
ДЕГЬ
LACT
LACT IMPAC
IMPAC

Google

NE
CLOTN
MAKE
FAT
WILL
NE MORE of CLOTN WILL MAKE IT PERSONA FAT GIRLK
of
IT
PERSONA
GIRLK
MORE