Human Generated Data

Title

Untitled (self-portrait)
Date

c. 1967
People

Artist: Aaron Siskind, American 1903 - 1991
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Carl Chiarenza and Heidi Katz, P1999.76
Copyright

© Estate of Aaron Siskind

Human Generated Data

Title

Untitled (self-portrait)

People

Artist: Aaron Siskind, American 1903 - 1991

Date

c. 1967

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Carl Chiarenza and Heidi Katz, P1999.76

Copyright

© Estate of Aaron Siskind

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Label 97.9
Text 97.9
Person 97.8
Human 97.8
Car 86.6
Transportation 86.6
Vehicle 86.6
Automobile 86.6
Milk 81.3
Beverage 81.3
Drink 81.3
Advertisement 80.1
Poster 75.3
Symbol 63.4
Alphabet 62.7
Word 61
Sticker 59.8

Clarifai
created on 2023-10-29

people 97.9
no person 97.5
text 94.9
adult 90.9
one 89.7
monochrome 89.1
bill 85.5
stock 85.1
vehicle 84.3
commerce 83.7
signal 83.6
war 82.5
administration 82.1
sign 82.1
wear 81.6
signalise 81.1
business 81
street 80.5
man 79.6
group 79.3

Imagga
created on 2022-06-25

barbershop 100
shop 100
mercantile establishment 91.4
place of business 60.9
sign 35.4
establishment 32.4
building 24.3
old 20.9
door 19
wall 18.8
city 17.5
telephone 15
urban 14.9
entrance 13.5
architecture 13.3
house 12.5
vintage 12.4
retro 12.3
street 12
structure 12
window 11.9
pay-phone 11.8
exterior 11.1
transportation 10.8
signs 10.7
business 10.3
town 10.2
road 9.9
advertising 9.6
symbol 9.4
travel 9.2
machine 9.1
information 8.9
brick 8.5
black 8.4
outdoors 8.2
restaurant 8.1
new 8.1
metal 8
home 8
design 7.9
public 7.8
facade 7.7
texture 7.6
arrow 7.6
electronic equipment 7.3

Google
created on 2022-06-25

Photograph 94.2
White 92.2
Black 89.8
Drinkware 87.2
Standing 86.4
Black-and-white 85.7
Style 83.9
Font 82.6
Tableware 82.3
Poster 78.9
Gas 77.8
Monochrome 74.6
Snapshot 74.3
Advertising 74.3
Signage 73.9
Monochrome photography 73.7
Eyewear 69.8
Art 68.6
Street 68.5
Billboard 68.3

Microsoft
created on 2022-06-25

text 99.9
soft drink 82
black and white 81.9
man 75.6
person 71.9
poster 71.1
human face 64
waste container 57.5
clothing 55.1
store 37.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 63.6%
Angry 22.5%
Surprised 7%
Confused 7%
Fear 6.1%
Sad 2.6%
Disgusted 1.6%
Happy 1.5%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Car
Milk
Person 97.8%
Car 86.6%
Milk 81.3%

Categories

Imagga

interior objects 83.4%
paintings art 5.9%
text visuals 5.3%
food drinks 4.1%

Captions

Microsoft
created on 2022-06-25

text, whiteboard 67.9%

Text analysis

Amazon

GIANT
SHAKE
SANDWICH
35
ASBESTOS
PUBLIC
BAR
LEPHONE
BEEF
COMPANY
PAULO KREZ
BIG

Google

$17 PUBLIC LEPHONE PALL KRE C ASBESTOS GIANT SHAKE 35 BAR BEEI SANDWICH
$
17
PUBLIC
LEPHONE
PALL
KRE
C
ASBESTOS
GIANT
SHAKE
35
BAR
BEEI
SANDWICH