Human Generated Data

Title

Untitled (Union Square and Fourteenth Street District, New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2830
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Union Square and Fourteenth Street District, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2830

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Architecture 99.4
Building 99.4
Hospital 99.4
Adult 99.2
Female 99.2
Person 99.2
Woman 99.2
Furniture 99.1
Infant Bed 99
Person 96.3
Baby 96.3
Face 94.9
Head 94.9
Person 93.7
Baby 93.7
Clothing 86.4
Hat 86.4
Bed 82.5
Person 76.1
Person 70
Crib 64
Indoors 60.3
Bonnet 56.3
Cradle 55.4
Clinic 55.2

Clarifai
created on 2018-05-10

people 99.9
adult 98.5
two 97.5
one 97.1
woman 95.7
administration 95.3
furniture 95
group 94.4
wear 93.1
group together 91.8
leader 90.1
man 89.9
seat 89.6
three 89.5
vehicle 89.5
lid 86.7
elderly 86.5
military 86.2
chair 85.6
child 84.7

Imagga
created on 2023-10-06

room 45.5
classroom 45
man 27.5
chair 27.3
people 26.8
person 26
building 22.3
sitting 20.6
indoors 19.3
male 19.2
home 19.1
adult 18.6
restaurant 18.2
interior 15.9
computer 15.3
lifestyle 15.2
laptop 15.2
smiling 13
work 12.9
old 12.5
working 12.4
table 12.1
men 12
happy 11.9
indoor 11.9
house 11.7
modern 11.2
occupation 11
shop 10.8
structure 10.8
couple 10.4
worker 10.1
library 9.8
family 9.8
business 9.7
portrait 9.7
day 9.4
industry 9.4
seat 9.3
inside 9.2
child 9.2
book 9.1
city 9.1
holding 9.1
industrial 9.1
one 9
urban 8.7
smile 8.5
casual 8.5
student 8.5
attractive 8.4
office 8.2
machine 8.2
light 8
job 8
happiness 7.8
boy 7.8
education 7.8
color 7.8
helmet 7.7
mother 7.7
scholar 7.6
equipment 7.6
furniture 7.6
technology 7.4
device 7.4
safety 7.4
cheerful 7.3
alone 7.3
looking 7.2
handsome 7.1
love 7.1
steel 7.1
architecture 7

Google
created on 2018-05-10

photograph 96.2
black 95.1
black and white 93.4
monochrome photography 86.7
snapshot 81.8
photography 81.7
standing 78.5
vintage clothing 77.7
monochrome 68.4
human behavior 66.8
stock photography 54.9
product 52

Microsoft
created on 2018-05-10

person 95.4
white 71.8
black 66.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Female, 99.9%
Calm 91.6%
Surprised 6.3%
Fear 5.9%
Sad 4.3%
Confused 1.7%
Disgusted 0.9%
Happy 0.2%
Angry 0.2%

AWS Rekognition

Age 0-3
Gender Female, 99.9%
Happy 69.9%
Calm 27.4%
Surprised 6.5%
Fear 6.1%
Sad 2.3%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 0-4
Gender Female, 100%
Happy 51.7%
Calm 38%
Surprised 12.4%
Fear 6%
Sad 2.2%
Disgusted 0.6%
Angry 0.2%
Confused 0.2%

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.2%
Female 99.2%
Person 99.2%
Woman 99.2%
Baby 96.3%
Crib 64%

Text analysis

Amazon

7"