Human Generated Data

Title

Photo-Cubism: 2 Wedding Portraits of Eliot, Nancy, and Spirit

Date

1976

People

Artist: Eric Chaffee, American active 1970s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3343

Human Generated Data

Title

Photo-Cubism: 2 Wedding Portraits of Eliot, Nancy, and Spirit

People

Artist: Eric Chaffee, American active 1970s

Date

1976

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Shelf 99.1
Human 98.5
Person 98.5
Furniture 95.8
Mammal 86.2
Animal 86.2
Canine 86.2
Pet 86.2
Dog 86.2
Collage 85.5
Poster 85.5
Advertisement 85.5
Bookcase 85.3
Person 83.3
Person 82.2
Chair 73
Person 70.9
Window 69.4
Prison 61.3
Silhouette 60.1
Person 44.4

Imagga
created on 2021-12-14

furniture 52.6
case 46.6
window 43.9
furnishing 33.8
bookcase 27.7
architecture 22.6
interior 21.2
building 19.4
old 17.4
house 15.9
shop 15.3
room 14
wall 13.7
modern 13.3
city 13.3
glass 13.2
indoors 13.2
chair 13
light 12.7
wood 11.7
urban 11.3
inside 11
silhouette 10.8
business 10.3
black 10.2
door 10.2
design 10.1
indoor 10
history 9.8
office 9.8
art 9.8
style 9.6
home 9.6
ancient 9.5
people 8.9
barbershop 8.9
fashion 8.3
wooden 7.9
windows 7.7
mercantile establishment 7.7
vintage 7.6
elegance 7.5
decoration 7.2
women 7.1
sliding door 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 94.7
indoor 93.1
black and white 92.6
clothing 91.6
furniture 91
person 86.9
house 79.8
table 79.4
monochrome 51.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Female, 92.7%
Happy 94.4%
Surprised 1.6%
Calm 1.5%
Fear 0.7%
Confused 0.7%
Angry 0.5%
Disgusted 0.3%
Sad 0.3%

AWS Rekognition

Age 29-45
Gender Male, 99.8%
Confused 59.3%
Calm 24%
Fear 5.8%
Angry 2.9%
Happy 2.7%
Surprised 2.2%
Sad 1.6%
Disgusted 1.5%

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Dog 86.2%
Chair 73%

Captions

Microsoft

Berit Kvæven et al. in a room 90.1%
Berit Kvæven et al. in a room next to a window 83.8%
Berit Kvæven et al. in a room near a window 83%