Human Generated Data

Title

Untitled (two men dressed as convicts with two dogs)
Date

1948
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15040

Human Generated Data

Title

Untitled (two men dressed as convicts with two dogs)

People

Artist: Jack Gould, American

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 90.4
Human 90.4
Animal 84.2
Wildlife 83.9
Mammal 83.7
Art 74.6
Zebra 69.7
Canine 63.5
Pet 63.5
Dog 63.5
Photography 57.8
Face 57.8
Photo 57.8
Portrait 57.8

Imagga
created on 2022-03-05

blackboard 90.3
monitor 62.6
interior 36.2
room 31.3
electronic equipment 30.7
home 29.5
modern 28.7
house 28.4
equipment 28.1
table 26.6
kitchen 25.3
furniture 22.7
luxury 19.7
design 19.7
chair 19.2
decor 18.6
window 18.1
architecture 18
apartment 16.3
light 16
decoration 15.2
contemporary 15
steel 15
oven 14.7
stainless 14.5
television 14.2
style 14.1
indoors 14
floor 13.9
indoor 13.7
estate 13.3
glass 13.2
stove 13
sink 12.7
luxurious 12.7
computer 11.7
building 11.7
residential 11.5
empty 11.2
technology 11.1
wall 11.1
inside 11
business 10.9
clean 10.8
expensive 10.5
new 10.5
lifestyle 10.1
3d 10.1
cook 10.1
wood 10
cabinet 9.8
counter 9.8
dining 9.5
refrigerator 9.3
elegance 9.2
domestic 9
cabinets 8.9
working 8.8
chairs 8.8
appliance 8.8
cooking 8.7
render 8.6
elegant 8.6
tile 8.6
real 8.5
cupboard 7.9
faucet 7.9
comfortable 7.6
hotel 7.6
living 7.6
communication 7.6
city 7.5
network 7.5
food 7.2
metal 7.2
success 7.2

Google
created on 2022-03-05

Black-and-white 86.2
Organism 85.3
Style 84
Giraffidae 81.7
Giraffe 79.7
Felidae 78.2
Rectangle 77.6
Sleeve 77.3
Monochrome photography 74.4
Monochrome 74.3
Art 73.1
Fish 72.8
Pattern 72.6
Font 71.9
Door 70.1
Skeleton 69.8
Terrestrial animal 69.8
Wildlife 68.3
Room 68.1
Big cats 66

Microsoft
created on 2022-03-05

text 94.4
black and white 83.3
animal 80.6
drawing 71.3

Face analysis

Amazon

Google

AWS Rekognition

Age 53-61
Gender Male, 98.7%
Sad 43.7%
Happy 37.4%
Surprised 7.8%
Calm 5.6%
Confused 2.4%
Disgusted 1.6%
Angry 1%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 90.4%
Dog 63.5%

Captions

Microsoft

a group of giraffe standing next to a window 33.8%
a giraffe standing in front of a window 33.7%
a group of people looking at a giraffe 33.6%

Text analysis

Amazon

SPORTING
AUTZ
OPERATOR
SPORTING HOUSE
HOUSE
Hudo
Hudo the her
the her

Google

the
HOUE
hel
AUTZ
Hudo
SPORTING
Hudo the hel AUTZ SPORTING HOUE OPERATOK
OPERATOK