Human Generated Data

Title

Untitled (a convict cowboy rides in the annual Texas Prison Rodeo, Huntsville)

Date

1980, printed later

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3832

Human Generated Data

Title

Untitled (a convict cowboy rides in the annual Texas Prison Rodeo, Huntsville)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1980, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Person 99.5
Human 99.5
Animal 99.4
Bull 99.4
Mammal 99.4
Person 99.4
Person 99.1
Horse 98.3
Person 98.2
Person 97.8
Person 97.4
Person 96.6
Person 95.5
Person 94.3
Bullfighter 92.3
Person 88.3
Person 87.4
Person 87.2
Person 85.9
Person 81.5
Bullfighting 79.9
Person 78.9
Rodeo 74.8
Person 70.4
Person 69.6
Person 63.2
Horse 62.8
Arena 55.8
Building 55.8
Stadium 55.8

Imagga
created on 2022-05-28

horse 100
vaulting horse 100
gymnastic apparatus 66.6
sports equipment 45.2
animal 35.6
horses 24.4
competition 23.8
sport 22.4
saddle 21.1
ride 20.4
equipment 19.3
cowboy 18.8
speed 18.3
riding 17.6
bull 17.1
rider 16.7
equestrian 16.7
jockey 15.8
animals 15.7
mammal 15.6
racing 13.7
race 13.4
horseback 12.8
outdoors 11.9
people 11.7
action 11.1
farm 10.7
western 10.7
pen 10.2
equine 10
herd 9.8
fight 9.7
country 9.7
wild 9.6
brown 9.6
sky 9.6
ranch 9.5
camel 9.4
man 9.4
fast 9.4
desert 9.3
history 8.9
game 8.9
bullfighting 8.9
fence 8.7
enclosure 8.5
travel 8.4
tourism 8.3
active 8.1
rural 7.9
bullring 7.9
courage 7.9
stallion 7.8
color 7.8
running 7.7
tradition 7.4
danger 7.3
national 7.2
sun 7.2
grass 7.1
athlete 7
helmet 7

Google
created on 2022-05-28

Microsoft
created on 2022-05-28

outdoor 94.4
person 93
animal 71
cowboy 65.8
text 65.1
horse 13.7

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 95.4%
Surprised 6.5%
Fear 5.9%
Sad 2.7%
Confused 1%
Happy 0.7%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.3%
Calm 87.4%
Surprised 7.9%
Fear 6%
Happy 4%
Sad 3.6%
Confused 0.8%
Angry 0.6%
Disgusted 0.3%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 78.3%
Surprised 8.3%
Confused 7.3%
Fear 6.3%
Sad 3.6%
Angry 3.5%
Disgusted 1.3%
Happy 1%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 29.9%
Happy 19.5%
Surprised 16.2%
Sad 13.7%
Fear 8.2%
Disgusted 7%
Angry 6.9%
Confused 5.2%

AWS Rekognition

Age 23-33
Gender Male, 98%
Calm 87%
Surprised 10.7%
Fear 5.9%
Happy 4.7%
Sad 2.2%
Confused 0.4%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 94.7%
Surprised 6.4%
Fear 6%
Sad 3.1%
Confused 1.1%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Female, 91.5%
Calm 68.8%
Happy 23.4%
Surprised 7.6%
Fear 6.2%
Sad 2.9%
Angry 1%
Disgusted 0.8%
Confused 0.7%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Calm 96.2%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Happy 1.3%
Disgusted 0.6%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 19-27
Gender Female, 54.7%
Calm 97%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Happy 1.6%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 18-26
Gender Male, 59.1%
Calm 82.7%
Confused 8%
Surprised 7%
Fear 6%
Happy 3%
Sad 2.9%
Angry 1.9%
Disgusted 0.6%

AWS Rekognition

Age 22-30
Gender Female, 50.7%
Calm 96.4%
Surprised 6.7%
Fear 5.9%
Sad 2.4%
Confused 0.8%
Angry 0.4%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 22-30
Gender Female, 72.4%
Calm 78.3%
Confused 9.6%
Surprised 8.1%
Fear 7%
Sad 3%
Happy 1.8%
Disgusted 1%
Angry 1%

AWS Rekognition

Age 21-29
Gender Male, 82.1%
Calm 77.2%
Surprised 10.7%
Fear 6.8%
Confused 3.7%
Sad 3.2%
Happy 2.5%
Disgusted 2.5%
Angry 2.2%

AWS Rekognition

Age 22-30
Gender Male, 95.3%
Calm 91.3%
Surprised 8.7%
Fear 6%
Sad 2.4%
Angry 1.3%
Happy 1%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 26-36
Gender Female, 99.2%
Calm 88.8%
Surprised 9.2%
Fear 6.1%
Sad 2.4%
Angry 2.2%
Happy 1.5%
Disgusted 0.7%
Confused 0.7%

AWS Rekognition

Age 22-30
Gender Female, 80.5%
Calm 54%
Surprised 20.9%
Confused 8.8%
Fear 7.9%
Sad 5.6%
Happy 5.5%
Disgusted 2.2%
Angry 1.9%

AWS Rekognition

Age 1-7
Gender Male, 97.2%
Sad 65.4%
Calm 44%
Fear 9.2%
Surprised 8.4%
Confused 6.1%
Disgusted 3.1%
Happy 2.8%
Angry 1.9%

AWS Rekognition

Age 24-34
Gender Male, 87%
Calm 96.6%
Surprised 6.4%
Fear 6%
Sad 2.4%
Happy 0.7%
Confused 0.7%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 29-39
Gender Female, 99%
Sad 100%
Surprised 6.5%
Fear 6.3%
Calm 5.9%
Happy 1.8%
Angry 0.9%
Confused 0.7%
Disgusted 0.5%

AWS Rekognition

Age 6-16
Gender Female, 67.6%
Calm 72.4%
Fear 8.7%
Surprised 7.8%
Confused 6.8%
Sad 4.2%
Happy 3.6%
Disgusted 1.8%
Angry 1.6%

AWS Rekognition

Age 9-17
Gender Male, 99.9%
Calm 98.5%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.5%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 89.7%
Surprised 7.5%
Fear 6.1%
Sad 2.7%
Disgusted 2.1%
Happy 1.8%
Confused 1.5%
Angry 0.5%

AWS Rekognition

Age 16-22
Gender Male, 85.8%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 1%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 91.8%
Surprised 9%
Fear 5.9%
Sad 2.2%
Happy 1.5%
Confused 1.2%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 10-18
Gender Male, 96.3%
Calm 63.8%
Surprised 11.6%
Fear 11.2%
Happy 9.1%
Sad 4%
Angry 2.4%
Disgusted 1.4%
Confused 0.5%

AWS Rekognition

Age 39-47
Gender Male, 97.1%
Calm 89.8%
Surprised 8.5%
Fear 6.2%
Confused 2.4%
Sad 2.3%
Happy 1.5%
Disgusted 0.9%
Angry 0.3%

AWS Rekognition

Age 12-20
Gender Female, 78.9%
Calm 87%
Surprised 8.6%
Fear 6.6%
Sad 3%
Disgusted 1.6%
Happy 1.1%
Confused 1.1%
Angry 1%

AWS Rekognition

Age 33-41
Gender Male, 86%
Calm 49.3%
Surprised 18.8%
Happy 17.9%
Fear 7.1%
Disgusted 6.1%
Sad 3.6%
Confused 2.9%
Angry 2.6%

AWS Rekognition

Age 16-22
Gender Male, 81.3%
Surprised 87.6%
Happy 20.2%
Calm 8.9%
Fear 7.4%
Angry 5.8%
Disgusted 4.1%
Sad 2.7%
Confused 1.6%

AWS Rekognition

Age 4-10
Gender Male, 78.2%
Calm 66.6%
Sad 30.2%
Surprised 7%
Fear 6.2%
Angry 6%
Disgusted 3%
Confused 0.9%
Happy 0.4%

AWS Rekognition

Age 33-41
Gender Male, 94.5%
Calm 89.6%
Surprised 7.4%
Fear 6.2%
Sad 2.5%
Happy 2.4%
Confused 2.3%
Disgusted 1.2%
Angry 0.6%

AWS Rekognition

Age 24-34
Gender Female, 95%
Sad 97.7%
Calm 26.1%
Surprised 12%
Fear 8.4%
Happy 3%
Confused 1.4%
Disgusted 1.2%
Angry 1.1%

AWS Rekognition

Age 18-26
Gender Male, 72.5%
Calm 47.5%
Disgusted 17.9%
Surprised 10.9%
Confused 7.6%
Fear 7.1%
Sad 6.2%
Happy 4.8%
Angry 4.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Horse 98.3%

Captions

Microsoft

a group of people riding on the back of a horse 72.6%
a person riding a horse in the snow 58%
a group of people walking in the snow 57.9%

Text analysis

Amazon

4
3
E
C.A

Google

3