Human Generated Data

Title

Untitled (Christmas picture, boy with dog posed in front of modern fireplace)

Date

1958

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18854

Human Generated Data

Title

Untitled (Christmas picture, boy with dog posed in front of modern fireplace)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Animal 99.8
Mammal 99.8
Dog 99.8
Pet 99.8
Canine 99.8
Person 99.6
Human 99.6
Furniture 98.1
Outdoors 95.2
Nature 93.9
Home Decor 82.9
Apparel 78.4
Clothing 78.4
Footwear 78.4
Shoe 78.4
Brick 77.1
Snow 73.2
Couch 62.8
Winter 61.7
Chair 58.7
Tire 58
Indoors 56.9
Fireplace 56.6
Husky 56
Shelf 55.9

Imagga
created on 2022-02-25

snow 41.1
sketch 39.6
drawing 33.4
shopping cart 31.9
winter 28.1
cold 25.8
handcart 25.5
wheeled vehicle 21.1
representation 19.9
house 16.7
architecture 16.5
city 15.8
newspaper 15.1
urban 14.9
people 14.5
frozen 13.4
floor 13
ice 12.9
product 12.9
container 12.4
park 12.3
tree 12.3
scene 12.1
weather 11.7
season 11.7
chair 11.5
sled 11.2
home 11.2
construction 11.1
day 11
dog 10.8
travel 10.6
frost 10.6
building 10.5
white goods 10.4
creation 10.3
men 10.3
sky 10.2
structure 10.2
conveyance 10.1
modern 9.8
interior 9.7
outdoors 9.7
rural 9.7
black 9.6
project 9.6
window 9.4
wall 9.4
outdoor 9.2
speed 9.2
landscape 8.9
snowy 8.8
man 8.7
architect 8.7
dishwasher 8.6
walk 8.6
bench 8.3
indoor 8.2
seat 7.9
women 7.9
seasonal 7.9
frosty 7.8
home appliance 7.8
glass 7.8
solitude 7.7
plan 7.6
wood 7.5
fun 7.5
business 7.3
metal 7.2
lifestyle 7.2
adult 7.2
trees 7.1
cool 7.1

Google
created on 2022-02-25

Dog 95.9
Plant 92.2
Building 89.9
Carnivore 88.5
Chair 84.8
Black-and-white 84.6
House 81.2
Companion dog 77.8
Dog breed 77.2
Tints and shades 76.8
Door 76.4
Monochrome 74.8
Monochrome photography 73.7
Home door 67.5
Sitting 66
Room 64.2
Brick 63.7
Flowerpot 63.5
Home 62.5
Canidae 60.6

Microsoft
created on 2022-02-25

dog 99.4
indoor 95.8
carnivore 91.9
animal 90.6
window 88.2
living 79.1
black 77.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Female, 99.9%
Happy 98.9%
Surprised 0.4%
Calm 0.2%
Fear 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0%

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Dog 99.8%
Person 99.6%
Shoe 78.4%

Captions

Microsoft

a dog sitting in front of a window 88.3%
a dog is sitting in front of a window 88.2%
a dog that is sitting in front of a window 86.7%