Human Generated Data

Title

Untitled (Lower East Side, New York City)
Date

April 1936
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2831
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Lower East Side, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2831

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2022-05-21

Human 99.5
Person 99.5
Bird 95
Animal 95
Poster 92.6
Advertisement 92.6
Person 84.6
Apparel 82.9
Clothing 82.9
Bird 73.6
Meal 72.3
Food 72.3
Cream 60.9
Icing 60.9
Dessert 60.9
Cake 60.9
Creme 60.9
Restaurant 58.9
Hat 58.7
Cafeteria 58.3
People 55.6
Cafe 55.1

Clarifai
created on 2023-10-29

people 99.8
monochrome 99.7
adult 98.3
woman 96.8
group 96.3
street 95.6
man 95.5
group together 94.9
two 91.4
bill 88.7
wear 88.5
music 88.4
retro 86.2
portrait 85.5
child 85.1
sit 84.6
one 84.4
many 82
coverage 81.1
boy 79.9

Imagga
created on 2022-05-21

barbershop 61
shop 51.6
mercantile establishment 40.2
place of business 26.8
black 25.3
world 22.8
blackboard 19.9
person 18.5
people 16.2
portrait 15.5
face 14.2
establishment 13.4
adult 12.9
man 12.1
eyes 12
dark 11.7
billboard 11.6
symbol 10.8
business 10.3
negative 10.2
male 9.9
film 9.8
human 9.7
expression 9.4
signboard 9.4
lights 9.3
global 9.1
pretty 9.1
attractive 9.1
skill 8.7
patriotic 8.6
close 8.6
nation 8.5
design 8.4
silhouette 8.3
flag 8.3
competition 8.2
make 8.2
sexy 8
light 8
night 8
hair 7.9
structure 7.8
cheering 7.8
audience 7.8
stadium 7.8
match 7.7
soccer 7.7
crowd 7.7
studio 7.6
sign 7.5
one 7.5
event 7.4
training 7.4
team 7.2
financial 7.1
smile 7.1

Google
created on 2022-05-21

Photograph 94.2
White 92.2
Black 89.7
Black-and-white 84.8
Font 83.9
Style 83.8
Bird 81.7
Monochrome 75.8
Monochrome photography 75.2
Snapshot 74.3
Room 69.2
Rectangle 66.7
Stock photography 63.6
Photo caption 60.5
Visual arts 56.9
Logo 55.5
Brand 54.4
Art 52.4
Photography 51.7
Darkness 51.1

Microsoft
created on 2022-05-21

text 99.9
poster 97.4
book 90
person 83.2
human face 83
cartoon 82.2
black and white 71
old 65.2
clothing 57.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-49
Gender Male, 100%
Angry 54.6%
Calm 38.2%
Surprised 6.7%
Fear 6.4%
Sad 2.7%
Disgusted 2%
Happy 0.8%
Confused 0.6%

AWS Rekognition

Age 21-29
Gender Female, 92.2%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.1%
Disgusted 0%
Happy 0%
Confused 0%

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Bird 95%
Poster 92.6%

Categories

Imagga

cars vehicles 26%
food drinks 25.5%
paintings art 22.6%
interior objects 20.3%
text visuals 2%
pets animals 2%

Captions

Microsoft
created on 2022-05-21

a group of people in an old photo of a person 57.2%
an old photo of a person 57.1%
old photo of a person 57%

Text analysis

Amazon

ARKET
CML
CML OS
OS
•186

Google

KET
כשר
מא
KET 186 כשר טשיקען מא
186
טשיקען