Human Generated Data

Title

Untitled (children with polio in wheelchairs, painting at table)
Date

1947
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15498

Human Generated Data

Title

Untitled (children with polio in wheelchairs, painting at table)

People

Artist: Jack Gould, American

Date

1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15498

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Wheel 99.8
Machine 99.8
Furniture 96.4
Person 94.3
Human 94.3
Person 86.5
Chair 85.1
Table 80.5
Sitting 78.2
Clinic 72.2
Room 71
Indoors 71
Flooring 62.2
People 56.6
Living Room 56.5
Desk 55.9
Clothing 55.8
Apparel 55.8

Clarifai
created on 2023-10-29

people 99.1
room 97.5
family 95.2
chair 94.3
monochrome 94.1
nostalgia 93.9
home 93.6
furniture 91.7
child 90.8
adult 88.3
two 88.2
house 87.9
man 86.5
indoors 84.6
vehicle 81.6
one 81.3
table 81
elderly 79.3
vintage 74.5
sit 74.3

Imagga
created on 2022-03-05

interior 64.5
room 53.7
table 52.3
furniture 51.1
home 45.6
chair 40.5
house 39.3
modern 37.8
floor 32.5
tile 31.3
decor 30.9
design 30.4
wood 30
architecture 29
window 27.5
luxury 25.7
apartment 23.9
residential 23
contemporary 22.6
kitchen 22.1
indoors 22
inside 21.2
decoration 20.4
seat 19.4
wall 19.2
chairs 18.6
indoor 18.3
domestic 17.2
style 17.1
elegance 16.8
light 16.7
mosaic 16.3
dining 16.2
3d 14.7
relaxation 14.2
corner 14
cabinet 13.5
lamp 13.4
glass 13.4
estate 13.3
living 13.3
nobody 13.2
wooden 13.2
art 12.8
clean 12.5
comfortable 12.4
door 12.4
building 12.4
empty 12
desk 12
sink 11.9
furnishing 11.6
dinner 10.9
creation 10.6
dining table 10.2
residence 9.9
plant 9.7
bathroom 9.7
sofa 9.6
equipment 9.2
structure 9.1
stylish 9
new 8.9
faucet 8.9
tables 8.9
metal 8.8
brown 8.8
oven 8.8
living room 8.8
luxurious 8.8
stove 8.7
render 8.6
patio 8.6
hotel 8.6
elegant 8.6
real 8.5
lifestyles 8.5
business 8.5
sliding door 8.5
decorative 8.3
cook 8.2
restaurant 8.2
refrigerator 8.2
office 8
steel 8
lifestyle 7.9
counter 7.9
cabinets 7.9
urban 7.9
vase 7.7
relax 7.6
blackboard 7.4
stool 7.3
food 7.2
armchair 7.1

Google
created on 2022-03-05

Furniture 93.7
Chair 91.2
Wheel 85.3
Table 83.8
Black-and-white 81.9
Art 80.7
Monochrome photography 71.9
Monochrome 71.1
Rectangle 67.1
Sitting 65.2
Room 63.3
Stock photography 62.9
Visual arts 62.5
Illustration 59.7
Still life photography 56.7
Vintage clothing 56.6
Office equipment 56.5
History 50.7
Sports equipment 50.2

Microsoft
created on 2022-03-05

table 92.9
text 91.5
furniture 91.5
black and white 81.3
chair 77.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 10-18
Gender Female, 75.4%
Calm 90.9%
Sad 3.1%
Happy 2.6%
Confused 2%
Fear 0.6%
Disgusted 0.4%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 10-18
Gender Female, 92.6%
Calm 70%
Sad 15.8%
Surprised 6.4%
Disgusted 2.7%
Angry 1.8%
Fear 1.3%
Happy 1.2%
Confused 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Wheel
Person
Chair
Wheel 99.8%
Person 94.3%
Person 86.5%
Chair 85.1%

Categories

Imagga

paintings art 83%
streetview architecture 9.4%
interior objects 7.3%

Captions

Microsoft
created on 2022-03-05

a man sitting on a table 73.3%
a man sitting at a table 73.2%
a man sitting in a chair 73.1%