Human Generated Data

Title

Untitled (men feeding apples to horse in store, children on horse back in costume)

Date

1956

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18650

Human Generated Data

Title

Untitled (men feeding apples to horse in store, children on horse back in costume)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.3
Person 99.3
Person 99.2
Person 95.3
Apparel 89.2
Clothing 89.2
Person 81.4
Horse 72.6
Mammal 72.6
Animal 72.6
Shelf 67.8
Flooring 55.4
Long Sleeve 55.4
Sleeve 55.4
Person 52.2

Imagga
created on 2022-03-05

turnstile 55
gate 48.1
movable barrier 33.7
interior 23.9
barrier 22.4
room 19.5
indoors 18.4
people 17.3
architecture 16.4
home 15.9
container 15.7
window 15
modern 14.7
bin 14.3
ashcan 14.2
house 14.2
city 14.1
white goods 14
floor 13.9
design 13.5
counter 13.4
light 13.4
refrigerator 13.2
business 12.7
urban 12.2
home appliance 11.6
obstruction 11.3
person 11.1
women 11.1
inside 11
furniture 10.9
clean 10.8
man 10.7
fashion 10.5
3d 10.1
appliance 10
chair 10
equipment 9.9
domestic 9.9
table 9.5
shop 9.5
building 9.2
adult 9.2
kitchen 9
decoration 8.9
steel 8.8
machine 8.8
apartment 8.6
life 8.6
commercial 8.4
elegance 8.4
street 8.3
indoor 8.2
group 8.1
decor 8
lifestyle 7.9
black 7.8
mall 7.8
station 7.7
luxury 7.7
wall 7.7
industry 7.7
percussion instrument 7.6
store 7.6
bucket 7.5
wood 7.5
style 7.4
steel drum 7.4
shopping 7.3
work 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 98.2
person 92
black and white 91.7
clothing 80.8
man 79.3
waste container 77.4
monochrome 65.5

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 75.2%
Happy 67.1%
Sad 18.4%
Calm 11.3%
Confused 1%
Surprised 0.9%
Disgusted 0.7%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 77.8%
Happy 19.5%
Surprised 0.8%
Sad 0.7%
Confused 0.6%
Disgusted 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 89.1%
Happy 63.1%
Calm 11.9%
Surprised 8.5%
Sad 7.2%
Angry 4.8%
Fear 1.8%
Disgusted 1.7%
Confused 1.1%

AWS Rekognition

Age 33-41
Gender Male, 65.6%
Calm 99.9%
Sad 0.1%
Happy 0%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Horse 72.6%

Captions

Microsoft

a group of people standing in front of a store 63.2%
a group of people standing in a store 59.6%
a group of people standing outside of a store 59.5%

Text analysis

Amazon

STIX
CHIPS
Tek
WITH
Finer...
Giffette
DRINK
10/
FAVORITE DRINK
-
eis
CHIPS - FRIA
FAVORITE
PRETZEL
POYATO
Nothing Finer...
FRIA
WITH COCHA
BLADES
Nothing
Suice
SCHULARS
BLUE BLADES
2x35
PRE
1-25
BLUE
NULERT
M
Gil
COCHA
DATE
addresses
JESEI
LOW

Google

46
46